Jun 24 09:39:12 devstack cinder-volume[82442]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 24 09:39:12 devstack cinder-volume[82442]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 24 09:39:12 devstack cinder-volume[82442]: we strongly recommend against using it for new projects. Jun 24 09:39:12 devstack cinder-volume[82442]: If you are already using Eventlet, we recommend migrating to a different Jun 24 09:39:12 devstack cinder-volume[82442]: framework. For more detail see Jun 24 09:39:12 devstack cinder-volume[82442]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 24 09:39:12 devstack cinder-volume[82442]: import eventlet # noqa Jun 24 09:39:14 devstack cinder-volume[82442]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82442) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 09:39:14 devstack cinder-volume[82442]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82442) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 09:39:14 devstack cinder-volume[82442]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82442) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 09:39:15 devstack cinder-volume[82442]: INFO dbcounter [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Registered counter for database cinder Jun 24 09:39:15 devstack cinder-volume[82442]: DEBUG oslo_db.sqlalchemy.engines [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82442) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 09:39:15 devstack cinder-volume[82442]: DEBUG dbcounter [-] [82442] Writer thread running {{(pid=82442) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 24 09:39:15 devstack cinder-volume[82442]: INFO cinder.rpc [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 24 09:39:15 devstack cinder-volume[82442]: INFO cinder.rpc [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 24 09:39:15 devstack cinder-volume[82442]: DEBUG oslo_db.sqlalchemy.engines [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82442) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 09:39:15 devstack cinder-volume[82442]: INFO cinder.volume.manager [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Determined volume DB was empty at startup. Jun 24 09:39:15 devstack cinder-volume[82442]: DEBUG cinder.volume.manager [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82442) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 24 09:39:15 devstack cinder-volume[82442]: INFO cinder.volume.manager [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 24 09:39:15 devstack cinder-volume[82442]: WARNING stevedore.named [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 24 09:39:15 devstack cinder-volume[82442]: WARNING castellan.key_manager [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 09:39:15 devstack cinder-volume[82442]: WARNING cinder.keymgr.conf_key_mgr [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 09:39:15 devstack cinder-volume[82442]: DEBUG cinder.volume.drivers.lvm [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82442) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 24 09:39:15 devstack cinder-volume[82442]: DEBUG oslo_concurrency.processutils [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_concurrency.processutils [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] CMD "cinder-rtstool verify" returned: 0 in 0.478s {{(pid=82442) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_db.sqlalchemy.engines [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82442) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 09:39:16 devstack cinder-volume[82442]: INFO cinder.rpc [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 24 09:39:16 devstack cinder-volume[82442]: INFO cinder.rpc [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 24 09:39:16 devstack cinder-volume[82442]: WARNING stevedore.named [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 24 09:39:16 devstack cinder-volume[82442]: WARNING castellan.key_manager [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 09:39:16 devstack cinder-volume[82442]: INFO cinder.volume.manager [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_db.sqlalchemy.engines [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82442) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 09:39:16 devstack cinder-volume[82442]: INFO oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Starting 1 workers Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Started child 82604 {{(pid=82442) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Full set of CONF: {{(pid=82442) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] ******************************************************************************** {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Configuration options gathered from: {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] ================================================================================ {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] allow_availability_zone_fallback = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] allow_compression_on_image_upload = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] allowed_direct_url_schemes = [] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] api_rate_limit = True {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] auth_strategy = keystone {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] az_cache_duration = 3600 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_availability_zone = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_host = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_name = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_stats_polling_interval = 60 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backup_api_class = cinder.backup.api.API {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backup_name_template = backup-%s {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backup_use_same_host = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backup_use_temp_snapshot = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] chap_password = **** {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] chap_username = {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cinder_internal_tenant_project_id = 4bc63da7d5e84172bac15e8cdfcfad02 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cinder_internal_tenant_user_id = 807b62122be142aca2955651a5299aba {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82604]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cloned_volume_same_az = True {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cluster = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] compression_format = gzip {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] compute_api_class = cinder.compute.nova.API {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] config_dir = [] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] config_source = [] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] control_exchange = openstack {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] debug = True {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] default_availability_zone = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] default_group_type = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] default_volume_type = lvmdriver-1 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] disk_geometry = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] driver_client_cert = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] driver_client_cert_key = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] driver_data_namespace = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] driver_ssl_cert_path = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] driver_ssl_cert_verify = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] driver_use_ssl = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] enable_force_upload = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] enable_new_services = True {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] enable_unsupported_driver = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] enabled_backends = ['lvmdriver-1'] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] enforce_multipath_for_image_xfer = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] filter_function = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] glance_api_insecure = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] glance_api_servers = ['http://192.168.122.237/image'] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] glance_api_ssl_compression = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] glance_ca_certificates_file = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] glance_catalog_info = image:glance:publicURL {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] glance_certfile = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] glance_keyfile = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] glance_num_retries = 3 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] glance_request_timeout = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] goodness_function = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] graceful_shutdown_timeout = 5 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] group_api_class = cinder.group.api.API {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] host = devstack {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] image_compress_on_upload = True {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] image_conversion_address_space_limit = 1 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] image_conversion_cpu_limit = 60 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] image_conversion_disable = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] image_upload_use_cinder_backend = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] image_upload_use_internal_tenant = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] image_volume_cache_enabled = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] image_volume_cache_max_count = 0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] image_volume_cache_max_size_gb = 0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] init_host_max_objects_retrieval = 0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] instance_format = [instance: %(uuid)s] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] iscsi_target_flags = {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] iscsi_write_cache = on {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] iser_helper = tgtadm {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] iser_ip_address = 192.168.122.237 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] iser_port = 3260 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] log_color = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] log_config_append = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] log_dir = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] log_file = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] log_options = True {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] log_rotate_interval = 1 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] log_rotate_interval_type = days {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] log_rotation_type = none {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] max_age = 0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] max_logfile_count = 30 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] max_logfile_size_mb = 200 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] max_over_subscription_ratio = 20.0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] message_reap_interval = 86400 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] message_ttl = 2592000 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] migration_create_volume_timeout_secs = 300 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] monkey_patch = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] monkey_patch_modules = [] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] my_ip = 192.168.122.237 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] no_snapshot_gb_quota = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] num_iser_scan_tries = 3 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] num_shell_tries = 3 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] num_volume_device_scan_tries = 3 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] nvmeof_conn_info_version = 1 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] nvmet_ns_id = 10 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] nvmet_port_id = 1 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] osapi_max_limit = 1000 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] osapi_volume_ext_list = [] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] osapi_volume_listen = 0.0.0.0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] osapi_volume_listen_port = 8776 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] osapi_volume_use_ssl = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] osapi_volume_workers = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] per_volume_size_limit = -1 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] periodic_fuzzy_delay = 60 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] periodic_interval = 60 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] project_id_regex = [0-9a-f\-]+ {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] public_endpoint = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] publish_errors = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] quota_backup_gigabytes = 1000 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] quota_backups = 10 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] quota_gigabytes = 1000 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] quota_groups = 10 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] quota_snapshots = 10 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] quota_volumes = 10 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] rate_limit_burst = 0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] rate_limit_except_level = CRITICAL {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] rate_limit_interval = 0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] reinit_driver_count = 3 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] replication_device = **** {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] report_discard_supported = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] report_interval = 120 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] reservation_clean_interval = 86400 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] reservation_expire = 86400 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] reserved_image_namespaces = [] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] reserved_percentage = 0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] rpc_response_timeout = 120 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] run_external_periodic_tasks = True {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] scst_target_driver = iscsi {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] scst_target_iqn_name = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] service_down_time = 720 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] shell_completion = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] snapshot_name_template = snapshot-%s {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] snapshot_same_host = True {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] split_loggers = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] state_path = /opt/stack/data/cinder {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] storage_availability_zone = nova {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] storage_protocol = iSCSI {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] syslog_log_facility = LOG_USER {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] target_helper = lioadm {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] target_ip_address = 192.168.122.237 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] target_port = 3260 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] target_protocol = iscsi {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] target_secondary_ip_addresses = [] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] trace_flags = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] transfer_api_class = cinder.transfer.api.API {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] transport_url = **** {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] until_refresh = 0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] use_chap_auth = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] use_default_quota_class = True {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] use_journal = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] use_json = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] use_multipath_for_image_xfer = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] use_stderr = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] use_syslog = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] verify_glance_signatures = enabled {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] volume_api_class = cinder.volume.api.API {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] volume_backend_name = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] volume_clear = zero {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] volume_clear_ionice = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] volume_clear_size = 0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82604]: INFO cinder.volume.manager [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] volume_copy_bps_limit = 0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] volume_dd_blocksize = 1M {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] volume_name_template = volume-%s {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] volume_service_inithost_offload = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] volume_usage_audit_period = month {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] zoning_mode = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_concurrency.disable_process_locking = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.auth_section = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.auth_type = password {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.auth_version = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.cache = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.certfile = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.delay_auth_decision = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.http_connect_timeout = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.include_service_catalog = True {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.insecure = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.interface = public {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.keyfile = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.memcache_password = {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.memcache_username = {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.region_name = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.service_token_roles_required = True {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.service_type = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.token_cache_time = 300 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.237/identity {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.backend = dogpile.cache.null {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.backend_argument = **** {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.backend_expiration_time = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.config_prefix = cache.oslo {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.debug_cache_backend = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.enable_retry_client = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.enable_socket_keepalive = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.enabled = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.expiration_time = 600 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.hashclient_retry_attempts = 2 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.memcache_dead_retry = 300 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.memcache_pool_maxsize = 10 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.memcache_sasl_enabled = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.password = **** {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.proxies = [] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.redis_db = 0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.redis_sentinel_service_name = mymaster {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.redis_server = localhost:6379 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.retry_attempts = 2 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.retry_delay = 0.0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.socket_keepalive_count = 1 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.socket_keepalive_idle = 1 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.socket_keepalive_interval = 1 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.socket_timeout = 1.0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.tls_allowed_ciphers = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.tls_cafile = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.tls_certfile = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.tls_enabled = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.tls_keyfile = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cache.username = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] coordination.backend_url = **** {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] database.asyncio_connection = **** {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] database.asyncio_slave_connection = **** {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] database.backend = sqlalchemy {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] database.connection = **** {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] database.connection_debug = 0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] database.connection_parameters = {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] database.connection_recycle_time = 3600 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] database.connection_trace = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] database.db_inc_retry_interval = True {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] database.db_max_retries = 20 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] database.db_max_retry_interval = 10 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] database.db_retry_interval = 1 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] database.max_overflow = 50 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] database.max_pool_size = 5 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] database.max_retries = 10 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] database.mysql_wsrep_sync_wait = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] database.pool_timeout = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] database.retry_interval = 10 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] database.slave_connection = **** {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] database.sqlite_synchronous = True {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] database.synchronous_reader = True {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] database.use_db_reconnect = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] profiler.connection_string = messaging:// {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] profiler.enabled = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] profiler.es_doc_type = notification {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] profiler.es_scroll_size = 10000 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] profiler.es_scroll_time = 2m {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] profiler.filter_error_trace = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] profiler.hmac_keys = **** {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] profiler.sentinel_service_name = mymaster {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] profiler.socket_timeout = 0.1 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] profiler.trace_requests = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] profiler.trace_sqlalchemy = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] profiler_jaeger.process_tags = {} {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] profiler_jaeger.service_name_prefix = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] profiler_otlp.service_name_prefix = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_policy.enforce_new_defaults = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: WARNING oslo_config.cfg [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_policy.enforce_scope = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_policy.policy_default_rule = default {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_policy.policy_file = policy.yaml {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_policy.remote_timeout = 60.0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] privsep_osbrick.group = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] privsep_osbrick.helper_command = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] privsep_osbrick.user = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cinder_sys_admin.group = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cinder_sys_admin.helper_command = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] cinder_sys_admin.user = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] service_user.auth_section = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] service_user.auth_type = password {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] service_user.cafile = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] service_user.certfile = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] service_user.collect_timing = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] service_user.insecure = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] service_user.keyfile = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] service_user.send_service_user_token = True {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] service_user.split_loggers = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] service_user.timeout = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] glance.auth_section = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] glance.auth_type = password {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] glance.certfile = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] glance.collect_timing = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] glance.insecure = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] glance.keyfile = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] glance.region_name = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] glance.split_loggers = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] glance.timeout = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.backend_availability_zone = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.chap_password = **** {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.chap_username = {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.disk_geometry = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.driver_client_cert = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.driver_client_cert_key = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.driver_data_namespace = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack sudo[82608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.driver_use_ssl = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.enable_unsupported_driver = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.extra_capabilities = {} {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.filter_function = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack sudo[82608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.goodness_function = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.iscsi_target_flags = {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.iscsi_write_cache = on {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.iser_helper = tgtadm {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.iser_ip_address = 192.168.122.237 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.iser_port = 3260 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.lvm_mirrors = 0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.lvm_share_target = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.lvm_type = auto {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.num_shell_tries = 3 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.nvmet_port_id = 1 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.replication_device = **** {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.report_discard_supported = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.reserved_percentage = 0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.scst_target_driver = iscsi {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.scst_target_iqn_name = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.storage_protocol = iSCSI {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.target_helper = tgtadm {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.target_ip_address = 192.168.122.237 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.target_port = 3260 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.target_protocol = iscsi {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.trace_flags = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.unique_fqdn_network = True {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.use_chap_auth = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.volume_backend_name = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.volume_clear = zero {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.volume_clear_ionice = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.volume_clear_size = 0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.volume_group = cinder-volumes {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_reports.file_event_handler = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_reports.log_dir = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.backend_availability_zone = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.backend_host = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.chap_password = **** {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.chap_username = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.chiscsi_conf = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.disk_geometry = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.driver_client_cert = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.driver_data_namespace = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.driver_use_ssl = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.extra_capabilities = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.filter_function = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.goodness_function = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.iser_helper = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.iser_ip_address = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.iser_port = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.iser_target_prefix = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.lvm_conf_file = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.lvm_mirrors = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.lvm_share_target = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.lvm_type = auto {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.num_shell_tries = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.nvmet_port_id = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.replication_device = **** {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.report_discard_supported = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.reserved_percentage = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.scst_target_driver = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.storage_protocol = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.target_helper = lioadm {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.target_ip_address = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.target_port = 3260 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.target_protocol = iscsi {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.trace_flags = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.use_chap_auth = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.volume_clear = zero {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.volume_clear_size = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] lvmdriver-1.volumes_dir = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.ssl = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.ssl_version = {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_notifications.driver = [] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_notifications.retry = -1 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] oslo_messaging_notifications.transport_url = **** {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] key_manager.fixed_key = **** {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican.barbican_api_version = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican.barbican_endpoint = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican.barbican_endpoint_type = public {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican.barbican_region_name = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican.cafile = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican.certfile = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican.collect_timing = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican.insecure = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican.keyfile = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican.number_of_retries = 60 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican.retry_delay = 1 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican.send_service_user_token = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican.split_loggers = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican.timeout = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican.verify_ssl = True {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican.verify_ssl_path = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican_service_user.auth_section = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican_service_user.auth_type = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican_service_user.cafile = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:17 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican_service_user.certfile = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:17 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican_service_user.collect_timing = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:17 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican_service_user.insecure = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:17 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican_service_user.keyfile = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:17 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican_service_user.split_loggers = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:17 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] barbican_service_user.timeout = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:17 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] vault.approle_role_id = **** {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:17 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] vault.approle_secret_id = **** {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:17 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] vault.kv_mountpoint = secret {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:17 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] vault.kv_path = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:17 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] vault.kv_version = 2 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:17 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] vault.namespace = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:17 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] vault.root_token_id = **** {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:17 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] vault.ssl_ca_crt_file = None {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:17 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] vault.timeout = 60.0 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:17 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] vault.use_ssl = False {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:17 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:39:17 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] ******************************************************************************** {{(pid=82442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 24 09:39:17 devstack sudo[82608]: pam_unix(sudo:session): session closed for user root Jun 24 09:39:17 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:17 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:17 devstack sudo[82658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 09:39:17 devstack sudo[82658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:39:18 devstack sudo[82658]: pam_unix(sudo:session): session closed for user root Jun 24 09:39:18 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.675s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:18 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 09:39:18 devstack cinder-volume[82604]: INFO cinder.brick.local_dev.lvm [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 24 09:39:18 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:18 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:18 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:18 devstack sudo[82911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 09:39:18 devstack sudo[82911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:39:18 devstack sudo[82911]: pam_unix(sudo:session): session closed for user root Jun 24 09:39:18 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.688s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:18 devstack cinder-volume[82604]: DEBUG cinder.brick.local_dev.lvm [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82604) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 24 09:39:18 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:18 devstack sudo[83147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 09:39:18 devstack sudo[83147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:39:20 devstack sudo[83147]: pam_unix(sudo:session): session closed for user root Jun 24 09:39:20 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.432s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:20 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:20 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:20 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:20 devstack sudo[83361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 09:39:20 devstack sudo[83361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:39:21 devstack sudo[83361]: pam_unix(sudo:session): session closed for user root Jun 24 09:39:21 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.729s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:21 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:21 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:21 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:21 devstack sudo[83389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 24 09:39:21 devstack sudo[83389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:39:21 devstack sudo[83389]: pam_unix(sudo:session): session closed for user root Jun 24 09:39:21 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.646s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:21 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:21 devstack sudo[83393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 09:39:21 devstack sudo[83393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:39:22 devstack sudo[83393]: pam_unix(sudo:session): session closed for user root Jun 24 09:39:22 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.750s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:22 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:22 devstack sudo[83402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 09:39:22 devstack sudo[83402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:39:23 devstack sudo[83402]: pam_unix(sudo:session): session closed for user root Jun 24 09:39:23 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:23 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:23 devstack sudo[83408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 09:39:23 devstack sudo[83408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:39:24 devstack sudo[83408]: pam_unix(sudo:session): session closed for user root Jun 24 09:39:24 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.827s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:24 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:24 devstack sudo[83414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 09:39:24 devstack sudo[83414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:39:24 devstack sudo[83414]: pam_unix(sudo:session): session closed for user root Jun 24 09:39:24 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.794s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:24 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:24 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:24 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:24 devstack sudo[83423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 09:39:24 devstack sudo[83423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:39:25 devstack sudo[83423]: pam_unix(sudo:session): session closed for user root Jun 24 09:39:25 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.638s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:25 devstack cinder-volume[82604]: INFO cinder.volume.drivers.lvm [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 24 09:39:25 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:25 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:25 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:25 devstack sudo[83428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 09:39:25 devstack sudo[83428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:39:26 devstack sudo[83428]: pam_unix(sudo:session): session closed for user root Jun 24 09:39:26 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.804s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:26 devstack cinder-volume[82604]: DEBUG cinder.volume.drivers.lvm [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Updating volume stats {{(pid=82604) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 09:39:26 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:26 devstack sudo[83542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 09:39:26 devstack sudo[83542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:39:26 devstack cinder-volume[82442]: DEBUG dbcounter [-] [82442] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82442) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:39:26 devstack sudo[83542]: pam_unix(sudo:session): session closed for user root Jun 24 09:39:26 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:27 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:27 devstack sudo[83553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 09:39:27 devstack sudo[83553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:39:27 devstack sudo[83553]: pam_unix(sudo:session): session closed for user root Jun 24 09:39:27 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:27 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:27 devstack sudo[83693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 09:39:27 devstack sudo[83693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:39:28 devstack sudo[83693]: pam_unix(sudo:session): session closed for user root Jun 24 09:39:28 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.639s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:28 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:28 devstack sudo[83697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 09:39:28 devstack sudo[83697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:39:28 devstack sudo[83697]: pam_unix(sudo:session): session closed for user root Jun 24 09:39:28 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:28 devstack cinder-volume[82604]: INFO cinder.volume.driver [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Driver hasn't implemented _init_vendor_properties() Jun 24 09:39:28 devstack cinder-volume[82604]: DEBUG cinder.volume.driver [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82604) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 24 09:39:28 devstack cinder-volume[82604]: DEBUG oslo_db.sqlalchemy.engines [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82604) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 09:39:29 devstack cinder-volume[82604]: DEBUG dbcounter [-] [82604] Writer thread running {{(pid=82604) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 24 09:39:29 devstack cinder-volume[82604]: DEBUG cinder.db.api [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Building query based on filter {{(pid=82604) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 24 09:39:29 devstack cinder-volume[82604]: DEBUG cinder.image.image_utils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82604) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 24 09:39:29 devstack cinder-volume[82604]: INFO cinder.keymgr.migration [None req-14565466-a7c0-43b5-b993-4587e9f271c1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 24 09:39:29 devstack cinder-volume[82604]: DEBUG cinder.volume.drivers.lvm [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Updating volume stats {{(pid=82604) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 09:39:29 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:29 devstack sudo[83701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 09:39:29 devstack sudo[83701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:39:29 devstack sudo[83701]: pam_unix(sudo:session): session closed for user root Jun 24 09:39:29 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:29 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:29 devstack sudo[83708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 09:39:29 devstack sudo[83708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:39:30 devstack sudo[83708]: pam_unix(sudo:session): session closed for user root Jun 24 09:39:30 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:30 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:30 devstack sudo[83711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 09:39:30 devstack sudo[83711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:39:30 devstack sudo[83711]: pam_unix(sudo:session): session closed for user root Jun 24 09:39:30 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:31 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:31 devstack sudo[83715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 09:39:31 devstack sudo[83715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:39:31 devstack sudo[83715]: pam_unix(sudo:session): session closed for user root Jun 24 09:39:31 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.692s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:31 devstack cinder-volume[82604]: DEBUG cinder.manager [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Notifying Schedulers of capabilities ... {{(pid=82604) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:39:31 devstack cinder-volume[82604]: INFO cinder.volume.manager [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Driver initialization completed successfully. Jun 24 09:39:31 devstack cinder-volume[82604]: INFO cinder.manager [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Initiating service 2 cleanup Jun 24 09:39:31 devstack cinder-volume[82604]: INFO cinder.manager [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Service 2 cleanup completed. Jun 24 09:39:31 devstack cinder-volume[82604]: DEBUG cinder.service [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Creating RPC server for service cinder-volume {{(pid=82604) start /opt/stack/cinder/cinder/service.py:231}} Jun 24 09:39:31 devstack cinder-volume[82604]: DEBUG cinder.service [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82604) start /opt/stack/cinder/cinder/service.py:237}} Jun 24 09:39:31 devstack cinder-volume[82604]: INFO cinder.volume.manager [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 24 09:39:31 devstack cinder-volume[82604]: DEBUG cinder.volume.drivers.lvm [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Updating volume stats {{(pid=82604) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 09:39:31 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:31 devstack sudo[83719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 09:39:31 devstack sudo[83719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:39:32 devstack sudo[83719]: pam_unix(sudo:session): session closed for user root Jun 24 09:39:32 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:32 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:32 devstack sudo[83723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 09:39:32 devstack sudo[83723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:39:33 devstack sudo[83723]: pam_unix(sudo:session): session closed for user root Jun 24 09:39:33 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:33 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:33 devstack sudo[83729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 09:39:33 devstack sudo[83729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:39:33 devstack sudo[83729]: pam_unix(sudo:session): session closed for user root Jun 24 09:39:33 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.650s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:33 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:39:33 devstack sudo[83786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 09:39:33 devstack sudo[83786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:39:34 devstack sudo[83786]: pam_unix(sudo:session): session closed for user root Jun 24 09:39:34 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:39:34 devstack cinder-volume[82604]: INFO cinder.volume.manager [None req-f7b6319a-f67e-4b23-aa56-f233a0f980f4 None None] Driver post RPC initialization completed successfully. Jun 24 09:39:41 devstack cinder-volume[82604]: DEBUG dbcounter [-] [82604] Writing DB stats cinder:SELECT=3 {{(pid=82604) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:39:44 devstack cinder-volume[82604]: DEBUG dbcounter [-] [82604] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82604) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:40:11 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Running periodic task VolumeManager._thread_info {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:40:11 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] thread count: 6 {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 09:40:11 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] thread info: [<_MainThread(MainThread, started 124180793782400)>, , , , , ] {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 09:41:11 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:41:11 devstack cinder-volume[82604]: DEBUG cinder.volume.drivers.lvm [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Updating volume stats {{(pid=82604) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 09:41:11 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:41:11 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 09:41:11 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:41:12 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Jun 24 09:41:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:41:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:41:12 devstack sudo[88634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 09:41:12 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:41:12 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root Jun 24 09:41:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:41:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:41:12 devstack sudo[88637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 09:41:12 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:41:13 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root Jun 24 09:41:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.633s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:41:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:41:13 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 09:41:13 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:41:14 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Jun 24 09:41:14 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:41:14 devstack cinder-volume[82604]: DEBUG cinder.manager [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Notifying Schedulers of capabilities ... {{(pid=82604) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:41:14 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Running periodic task VolumeManager._thread_info {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:41:14 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] thread count: 6 {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 09:41:14 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] thread info: [<_MainThread(MainThread, started 124180793782400)>, , , , , ] {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 09:41:44 devstack cinder-volume[82604]: DEBUG dbcounter [-] [82604] Writing DB stats cinder:SELECT=1 {{(pid=82604) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:41:44 devstack cinder-volume[82604]: DEBUG dbcounter [-] [82604] Writing DB stats cinder:UPDATE=1 {{(pid=82604) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:42:11 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:42:11 devstack cinder-volume[82604]: DEBUG cinder.volume.drivers.lvm [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Updating volume stats {{(pid=82604) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 09:42:11 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:42:11 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 09:42:11 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:42:12 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Jun 24 09:42:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:42:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:42:12 devstack sudo[89074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 09:42:12 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:42:12 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root Jun 24 09:42:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:42:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:42:12 devstack sudo[89086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 09:42:12 devstack sudo[89086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:42:13 devstack sudo[89086]: pam_unix(sudo:session): session closed for user root Jun 24 09:42:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.624s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:42:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:42:13 devstack sudo[89092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 09:42:13 devstack sudo[89092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:42:14 devstack sudo[89092]: pam_unix(sudo:session): session closed for user root Jun 24 09:42:14 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:42:14 devstack cinder-volume[82604]: DEBUG cinder.manager [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Notifying Schedulers of capabilities ... {{(pid=82604) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:42:14 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Running periodic task VolumeManager._thread_info {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:42:14 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] thread count: 6 {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 09:42:14 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] thread info: [<_MainThread(MainThread, started 124180793782400)>, , , , , ] {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 09:43:11 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:43:11 devstack cinder-volume[82604]: DEBUG cinder.volume.drivers.lvm [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Updating volume stats {{(pid=82604) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 09:43:11 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:43:11 devstack sudo[91203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 09:43:11 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:43:12 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root Jun 24 09:43:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:43:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:43:12 devstack sudo[91206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 09:43:12 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:43:12 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root Jun 24 09:43:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:43:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:43:12 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 09:43:12 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:43:13 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Jun 24 09:43:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.642s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:43:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:43:13 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 09:43:13 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:43:14 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Jun 24 09:43:14 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:43:14 devstack cinder-volume[82604]: DEBUG cinder.manager [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Notifying Schedulers of capabilities ... {{(pid=82604) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:43:14 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Running periodic task VolumeManager._thread_info {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:43:14 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] thread count: 6 {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 09:43:14 devstack cinder-volume[82604]: DEBUG cinder.volume.manager [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] thread info: [<_MainThread(MainThread, started 124180793782400)>, , , , , ] {{(pid=82604) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 09:43:44 devstack cinder-volume[82604]: DEBUG dbcounter [-] [82604] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82604) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:44:11 devstack cinder-volume[82604]: DEBUG oslo_service.periodic_task [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82604) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:44:11 devstack cinder-volume[82604]: DEBUG cinder.volume.drivers.lvm [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Updating volume stats {{(pid=82604) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 24 09:44:11 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:44:11 devstack sudo[92416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 24 09:44:11 devstack sudo[92416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:44:12 devstack sudo[92416]: pam_unix(sudo:session): session closed for user root Jun 24 09:44:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:44:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:44:12 devstack sudo[92477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 09:44:12 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:44:12 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root Jun 24 09:44:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:44:12 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:44:12 devstack sudo[92506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 24 09:44:12 devstack sudo[92506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:44:13 devstack sudo[92506]: pam_unix(sudo:session): session closed for user root Jun 24 09:44:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.658s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:44:13 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:44:13 devstack sudo[92536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 24 09:44:13 devstack sudo[92536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:44:14 devstack sudo[92536]: pam_unix(sudo:session): session closed for user root Jun 24 09:44:14 devstack cinder-volume[82604]: DEBUG oslo_concurrency.processutils [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=82604) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:44:14 devstack cinder-volume[82604]: DEBUG cinder.manager [None req-9917ac63-5a80-440f-830e-31e438038db8 None None] Notifying Schedulers of capabilities ... {{(pid=82604) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:44:16 devstack cinder-volume[82442]: INFO oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Caught SIGTERM, stopping children Jun 24 09:44:16 devstack cinder-volume[82442]: DEBUG oslo_concurrency.lockutils [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Acquiring lock "singleton_lock" {{(pid=82442) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 09:44:16 devstack cinder-volume[82442]: DEBUG oslo_concurrency.lockutils [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Acquired lock "singleton_lock" {{(pid=82442) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 09:44:16 devstack cinder-volume[82442]: DEBUG oslo_concurrency.lockutils [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Releasing lock "singleton_lock" {{(pid=82442) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 09:44:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Stop services. {{(pid=82442) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 24 09:44:16 devstack cinder-volume[82442]: DEBUG oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Killing children. {{(pid=82442) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 24 09:44:16 devstack cinder-volume[82442]: INFO oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Waiting on 1 children to exit Jun 24 09:44:16 devstack cinder-volume[82604]: DEBUG oslo_concurrency.lockutils [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Acquiring lock "singleton_lock" {{(pid=82604) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 09:44:16 devstack cinder-volume[82604]: DEBUG oslo_concurrency.lockutils [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Acquired lock "singleton_lock" {{(pid=82604) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 09:44:16 devstack cinder-volume[82604]: DEBUG oslo_concurrency.lockutils [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Releasing lock "singleton_lock" {{(pid=82604) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 09:44:16 devstack cinder-volume[82604]: WARNING amqp [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 24 09:44:16 devstack cinder-volume[82604]: WARNING amqp [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 24 09:44:16 devstack cinder-volume[82442]: INFO oslo_service.backend._eventlet.service [None req-7b9f0768-a469-4e9c-a8e8-e9d9c01b77cd None None] Child 82604 exited with status 0 Jun 24 09:44:17 devstack cinder-volume[92698]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 24 09:44:17 devstack cinder-volume[92698]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 24 09:44:17 devstack cinder-volume[92698]: we strongly recommend against using it for new projects. Jun 24 09:44:17 devstack cinder-volume[92698]: If you are already using Eventlet, we recommend migrating to a different Jun 24 09:44:17 devstack cinder-volume[92698]: framework. For more detail see Jun 24 09:44:17 devstack cinder-volume[92698]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 24 09:44:17 devstack cinder-volume[92698]: import eventlet # noqa Jun 24 09:44:19 devstack cinder-volume[92698]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92698) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 09:44:19 devstack cinder-volume[92698]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92698) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 09:44:19 devstack cinder-volume[92698]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92698) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 09:44:19 devstack cinder-volume[92698]: INFO dbcounter [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Registered counter for database cinder Jun 24 09:44:19 devstack cinder-volume[92698]: DEBUG oslo_db.sqlalchemy.engines [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92698) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG dbcounter [-] [92698] Writer thread running {{(pid=92698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 24 09:44:20 devstack cinder-volume[92698]: INFO cinder.rpc [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 24 09:44:20 devstack cinder-volume[92698]: INFO cinder.rpc [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_db.sqlalchemy.engines [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92698) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 09:44:20 devstack cinder-volume[92698]: INFO cinder.volume.manager [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Determined volume DB was empty at startup. Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG cinder.volume.manager [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92698) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 24 09:44:20 devstack cinder-volume[92698]: INFO cinder.volume.manager [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 24 09:44:20 devstack cinder-volume[92698]: WARNING stevedore.named [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 24 09:44:20 devstack cinder-volume[92698]: WARNING castellan.key_manager [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 09:44:20 devstack cinder-volume[92698]: WARNING cinder.keymgr.conf_key_mgr [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 09:44:20 devstack cinder-volume[92698]: INFO cinder.volume.manager [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_db.sqlalchemy.engines [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92698) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 09:44:20 devstack cinder-volume[92698]: INFO oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Starting 1 workers Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Started child 92913 {{(pid=92698) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Full set of CONF: {{(pid=92698) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] ******************************************************************************** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Configuration options gathered from: {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] ================================================================================ {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] allow_availability_zone_fallback = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] allow_compression_on_image_upload = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] allowed_direct_url_schemes = [] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] api_rate_limit = True {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] auth_strategy = keystone {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_availability_zone = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92913]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_host = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_name = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_stats_polling_interval = 60 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backup_api_class = cinder.backup.api.API {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backup_name_template = backup-%s {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backup_use_same_host = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backup_use_temp_snapshot = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] chap_password = **** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] chap_username = {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cinder_internal_tenant_project_id = 4bc63da7d5e84172bac15e8cdfcfad02 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cinder_internal_tenant_user_id = 807b62122be142aca2955651a5299aba {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cluster = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] compression_format = gzip {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] compute_api_class = cinder.compute.nova.API {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] config_dir = [] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] config_source = [] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] control_exchange = openstack {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] debug = True {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] default_availability_zone = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] default_group_type = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] default_volume_type = QuobyteHD {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] disk_geometry = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] driver_client_cert = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] driver_client_cert_key = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] driver_data_namespace = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] driver_ssl_cert_path = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] driver_ssl_cert_verify = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] driver_use_ssl = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] enable_new_services = True {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] enable_unsupported_driver = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] enabled_backends = ['QuobyteHD'] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] enforce_multipath_for_image_xfer = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] filter_function = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] glance_api_insecure = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] glance_api_servers = ['http://192.168.122.237/image'] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] glance_api_ssl_compression = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] glance_ca_certificates_file = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] glance_catalog_info = image:glance:publicURL {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] glance_certfile = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] glance_keyfile = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] glance_num_retries = 3 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] glance_request_timeout = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] goodness_function = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] graceful_shutdown_timeout = 5 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] group_api_class = cinder.group.api.API {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] host = devstack {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] image_compress_on_upload = True {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] image_conversion_address_space_limit = 1 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] image_conversion_cpu_limit = 60 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] image_conversion_disable = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] image_upload_use_cinder_backend = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] image_upload_use_internal_tenant = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] image_volume_cache_enabled = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] image_volume_cache_max_count = 0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] image_volume_cache_max_size_gb = 0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] init_host_max_objects_retrieval = 0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] instance_format = [instance: %(uuid)s] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] iscsi_target_flags = {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] iscsi_write_cache = on {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] iser_helper = tgtadm {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] iser_ip_address = 192.168.122.237 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] iser_port = 3260 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] log_color = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] log_config_append = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] log_dir = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] log_file = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] log_options = True {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] log_rotate_interval = 1 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] log_rotate_interval_type = days {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] log_rotation_type = none {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] max_age = 0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] max_logfile_count = 30 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] max_logfile_size_mb = 200 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] max_over_subscription_ratio = 20.0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] message_reap_interval = 86400 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] message_ttl = 2592000 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] migration_create_volume_timeout_secs = 300 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] monkey_patch = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] monkey_patch_modules = [] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] my_ip = 192.168.122.237 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] no_snapshot_gb_quota = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] num_iser_scan_tries = 3 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] num_shell_tries = 3 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] num_volume_device_scan_tries = 3 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] nvmeof_conn_info_version = 1 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] nvmet_ns_id = 10 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] nvmet_port_id = 1 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] osapi_max_limit = 1000 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92913]: INFO cinder.volume.manager [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 24 09:44:20 devstack cinder-volume[92913]: DEBUG cinder.volume.drivers.remotefs [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=92913) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] osapi_volume_ext_list = [] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] osapi_volume_listen = 0.0.0.0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] osapi_volume_listen_port = 8776 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] osapi_volume_use_ssl = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] osapi_volume_workers = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] per_volume_size_limit = -1 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] periodic_fuzzy_delay = 60 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] periodic_interval = 60 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] project_id_regex = [0-9a-f\-]+ {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] public_endpoint = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] publish_errors = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] quota_backup_gigabytes = 1000 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] quota_backups = 10 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] quota_gigabytes = 1000 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] quota_groups = 10 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] quota_snapshots = 10 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] quota_volumes = 10 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] rate_limit_burst = 0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] rate_limit_except_level = CRITICAL {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] rate_limit_interval = 0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] reinit_driver_count = 3 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] replication_device = **** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] report_discard_supported = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] report_interval = 120 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] reservation_clean_interval = 86400 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] reservation_expire = 86400 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] reserved_image_namespaces = [] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] reserved_percentage = 0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] rpc_response_timeout = 120 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] run_external_periodic_tasks = True {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] scst_target_driver = iscsi {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] scst_target_iqn_name = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] service_down_time = 720 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] shell_completion = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] snapshot_name_template = snapshot-%s {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] split_loggers = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] state_path = /opt/stack/data/cinder {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] storage_availability_zone = nova {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] storage_protocol = iSCSI {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] syslog_log_facility = LOG_USER {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] target_helper = lioadm {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] target_ip_address = 192.168.122.237 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] target_port = 3260 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] target_protocol = iscsi {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] target_secondary_ip_addresses = [] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] trace_flags = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] transfer_api_class = cinder.transfer.api.API {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] transport_url = **** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] until_refresh = 0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] use_chap_auth = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] use_default_quota_class = True {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] use_journal = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] use_json = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] use_multipath_for_image_xfer = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] use_stderr = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] use_syslog = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] verify_glance_signatures = enabled {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] volume_api_class = cinder.volume.api.API {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] volume_backend_name = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] volume_clear = zero {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] volume_clear_ionice = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] volume_clear_size = 0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] volume_copy_bps_limit = 0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] volume_dd_blocksize = 1M {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] volume_name_template = volume-%s {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] volume_service_inithost_offload = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] volume_usage_audit_period = month {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] zoning_mode = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_concurrency.disable_process_locking = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.auth_section = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.auth_type = password {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92913]: DEBUG cinder.volume.drivers.quobyte [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=92913) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 24 09:44:20 devstack cinder-volume[92913]: WARNING cinder.volume.drivers.quobyte [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 24 09:44:20 devstack cinder-volume[92913]: WARNING cinder.volume.drivers.quobyte [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 24 09:44:20 devstack cinder-volume[92913]: DEBUG oslo_concurrency.processutils [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Running cmd (subprocess): mount.quobyte {{(pid=92913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.auth_version = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.cache = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.certfile = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.delay_auth_decision = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.http_connect_timeout = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.include_service_catalog = True {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.insecure = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.interface = public {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.keyfile = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.memcache_password = {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.memcache_username = {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.region_name = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.service_token_roles_required = True {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.service_type = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.token_cache_time = 300 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.237/identity {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.backend = dogpile.cache.null {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.backend_argument = **** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.backend_expiration_time = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.config_prefix = cache.oslo {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.debug_cache_backend = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.enable_retry_client = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.enable_socket_keepalive = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.enabled = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.expiration_time = 600 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.hashclient_retry_attempts = 2 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.memcache_dead_retry = 300 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.memcache_pool_maxsize = 10 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.memcache_sasl_enabled = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.password = **** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.proxies = [] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.redis_db = 0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.redis_sentinel_service_name = mymaster {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.redis_server = localhost:6379 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.retry_attempts = 2 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.retry_delay = 0.0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.socket_keepalive_count = 1 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.socket_keepalive_idle = 1 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.socket_keepalive_interval = 1 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.socket_timeout = 1.0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.tls_allowed_ciphers = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.tls_cafile = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.tls_certfile = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.tls_enabled = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.tls_keyfile = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cache.username = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] coordination.backend_url = **** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] database.asyncio_connection = **** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] database.asyncio_slave_connection = **** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] database.backend = sqlalchemy {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] database.connection = **** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] database.connection_debug = 0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] database.connection_parameters = {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] database.connection_recycle_time = 3600 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] database.connection_trace = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] database.db_inc_retry_interval = True {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] database.db_max_retries = 20 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] database.db_max_retry_interval = 10 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] database.db_retry_interval = 1 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] database.max_overflow = 50 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] database.max_pool_size = 5 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] database.max_retries = 10 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] database.mysql_wsrep_sync_wait = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] database.pool_timeout = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] database.retry_interval = 10 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] database.slave_connection = **** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] database.sqlite_synchronous = True {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] database.synchronous_reader = True {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] database.use_db_reconnect = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] profiler.connection_string = messaging:// {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] profiler.enabled = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] profiler.es_doc_type = notification {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] profiler.es_scroll_size = 10000 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] profiler.es_scroll_time = 2m {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] profiler.filter_error_trace = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] profiler.hmac_keys = **** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] profiler.sentinel_service_name = mymaster {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] profiler.socket_timeout = 0.1 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] profiler.trace_requests = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] profiler.trace_sqlalchemy = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] profiler_jaeger.process_tags = {} {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] profiler_jaeger.service_name_prefix = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] profiler_otlp.service_name_prefix = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_policy.enforce_new_defaults = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: WARNING oslo_config.cfg [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_policy.enforce_scope = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_policy.policy_default_rule = default {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_policy.policy_file = policy.yaml {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_policy.remote_timeout = 60.0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] privsep_osbrick.group = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] privsep_osbrick.helper_command = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] privsep_osbrick.user = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cinder_sys_admin.group = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cinder_sys_admin.helper_command = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] cinder_sys_admin.user = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] service_user.auth_section = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] service_user.auth_type = password {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] service_user.cafile = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] service_user.certfile = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] service_user.collect_timing = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] service_user.insecure = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] service_user.keyfile = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] service_user.send_service_user_token = True {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] service_user.split_loggers = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] service_user.timeout = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] glance.auth_section = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] glance.auth_type = password {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] glance.certfile = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] glance.collect_timing = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] glance.insecure = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] glance.keyfile = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] glance.region_name = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] glance.split_loggers = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] glance.timeout = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.backend_availability_zone = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.chap_password = **** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.chap_username = {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.disk_geometry = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.driver_client_cert = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.driver_client_cert_key = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.driver_data_namespace = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.driver_use_ssl = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.enable_unsupported_driver = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.extra_capabilities = {} {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.filter_function = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.goodness_function = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.iscsi_target_flags = {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.iscsi_write_cache = on {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.iser_helper = tgtadm {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.iser_ip_address = 192.168.122.237 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.iser_port = 3260 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.nas_host = {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.nas_login = admin {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.nas_mount_options = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.nas_password = **** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.nas_private_key = {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.nas_share_path = {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.nas_ssh_port = 22 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.num_shell_tries = 3 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.nvmet_port_id = 1 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.quobyte_client_cfg = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.quobyte_volume_url = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.replication_device = **** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.report_discard_supported = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.reserved_percentage = 0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.scst_target_driver = iscsi {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.scst_target_iqn_name = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.storage_protocol = iSCSI {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.target_helper = tgtadm {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.target_ip_address = 192.168.122.237 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.target_port = 3260 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.target_protocol = iscsi {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.trace_flags = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.unique_fqdn_network = True {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.use_chap_auth = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.volume_backend_name = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.volume_clear = zero {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.volume_clear_ionice = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.volume_clear_size = 0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_reports.file_event_handler = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_reports.log_dir = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.backend_availability_zone = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.backend_host = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.chap_password = **** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.chap_username = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.chiscsi_conf = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.disk_geometry = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.driver_client_cert = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.driver_client_cert_key = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.driver_data_namespace = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.driver_use_ssl = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.extra_capabilities = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.filter_function = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.goodness_function = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.iscsi_target_flags = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.iscsi_write_cache = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.iser_helper = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.iser_ip_address = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92913]: DEBUG oslo_concurrency.processutils [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] CMD "mount.quobyte" returned: 1 in 0.124s {{(pid=92913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.iser_port = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.iser_target_prefix = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.nas_host = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.nas_login = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.nas_mount_options = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.nas_password = **** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.nas_private_key = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.nas_share_path = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.nas_ssh_port = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.num_shell_tries = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92913]: DEBUG cinder.volume.drivers.quobyte [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=92913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.nvmet_ns_id = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.nvmet_port_id = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92913]: INFO cinder.volume.drivers.quobyte [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb ... Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.replication_device = **** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.report_discard_supported = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.reserved_percentage = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.scst_target_driver = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.storage_protocol = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92913]: DEBUG oslo_concurrency.processutils [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 -c /etc/quobyte/client-cinder.cfg {{(pid=92913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.target_helper = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.target_ip_address = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.target_port = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.target_prefix = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.target_protocol = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.trace_flags = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.unique_fqdn_network = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.use_chap_auth = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.volume_clear = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.volume_clear_ionice = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.volume_clear_size = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:20 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] QuobyteHD.volumes_dir = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.ssl = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.ssl_version = {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_notifications.driver = [] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_notifications.retry = -1 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] oslo_messaging_notifications.transport_url = **** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] key_manager.fixed_key = **** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican.barbican_api_version = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican.barbican_endpoint = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican.barbican_endpoint_type = public {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican.barbican_region_name = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican.cafile = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican.certfile = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican.collect_timing = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican.insecure = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican.keyfile = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican.number_of_retries = 60 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican.retry_delay = 1 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican.send_service_user_token = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican.split_loggers = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican.timeout = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican.verify_ssl = True {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican.verify_ssl_path = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican_service_user.auth_section = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican_service_user.auth_type = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican_service_user.cafile = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican_service_user.certfile = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican_service_user.collect_timing = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican_service_user.insecure = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican_service_user.keyfile = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican_service_user.split_loggers = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] barbican_service_user.timeout = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] vault.approle_role_id = **** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] vault.approle_secret_id = **** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] vault.kv_mountpoint = secret {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] vault.kv_path = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] vault.kv_version = 2 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] vault.namespace = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] vault.root_token_id = **** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] vault.ssl_ca_crt_file = None {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 -c /etc/quobyte/client-cinder.cfg Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] vault.timeout = 60.0 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] vault.use_ssl = False {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:21 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] ******************************************************************************** {{(pid=92698) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 24 09:44:21 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:44:21 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Jun 24 09:44:21 devstack cinder-volume[92913]: DEBUG oslo_concurrency.processutils [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.792s {{(pid=92913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:44:21 devstack cinder-volume[92913]: INFO cinder.volume.drivers.quobyte [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb succeeded Jun 24 09:44:21 devstack cinder-volume[92913]: DEBUG cinder.volume.drivers.quobyte [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=92913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:44:21 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.807s {{(pid=92913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:44:21 devstack cinder-volume[92913]: DEBUG oslo_concurrency.processutils [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=92913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:44:21 devstack sudo[92988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:44:21 devstack sudo[92988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:44:22 devstack sudo[92988]: pam_unix(sudo:session): session closed for user root Jun 24 09:44:22 devstack cinder-volume[92913]: DEBUG oslo_concurrency.processutils [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.617s {{(pid=92913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:44:22 devstack cinder-volume[92913]: INFO cinder.volume.driver [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Driver hasn't implemented _init_vendor_properties() Jun 24 09:44:22 devstack cinder-volume[92913]: DEBUG cinder.volume.driver [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7392196655273, 'free_capacity_gb': 1775.7392196655273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92913) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 24 09:44:22 devstack cinder-volume[92913]: DEBUG oslo_db.sqlalchemy.engines [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92913) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 09:44:22 devstack cinder-volume[92913]: DEBUG dbcounter [-] [92913] Writer thread running {{(pid=92913) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 24 09:44:22 devstack cinder-volume[92913]: DEBUG cinder.db.api [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Building query based on filter {{(pid=92913) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 24 09:44:22 devstack cinder-volume[92913]: DEBUG cinder.image.image_utils [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=92913) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 24 09:44:22 devstack cinder-volume[92913]: INFO cinder.keymgr.migration [None req-ab23a61f-be39-4873-a5f9-af13e5543797 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 24 09:44:22 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:44:22 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:44:22 devstack cinder-volume[92913]: DEBUG cinder.volume.drivers.quobyte [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=92913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:44:22 devstack cinder-volume[92913]: DEBUG cinder.volume.drivers.quobyte [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=92913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:44:22 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:44:22 devstack cinder-volume[92913]: DEBUG oslo_concurrency.processutils [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=92913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:44:22 devstack sudo[92991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:44:22 devstack sudo[92991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:44:23 devstack sudo[92991]: pam_unix(sudo:session): session closed for user root Jun 24 09:44:23 devstack cinder-volume[92913]: DEBUG oslo_concurrency.processutils [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.691s {{(pid=92913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:44:23 devstack cinder-volume[92913]: DEBUG cinder.manager [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Notifying Schedulers of capabilities ... {{(pid=92913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:44:23 devstack cinder-volume[92913]: INFO cinder.volume.manager [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Driver initialization completed successfully. Jun 24 09:44:23 devstack cinder-volume[92913]: INFO cinder.manager [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Initiating service 3 cleanup Jun 24 09:44:23 devstack cinder-volume[92913]: INFO cinder.manager [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Service 3 cleanup completed. Jun 24 09:44:23 devstack cinder-volume[92913]: DEBUG cinder.service [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Creating RPC server for service cinder-volume {{(pid=92913) start /opt/stack/cinder/cinder/service.py:231}} Jun 24 09:44:23 devstack cinder-volume[92913]: DEBUG cinder.service [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=92913) start /opt/stack/cinder/cinder/service.py:237}} Jun 24 09:44:23 devstack cinder-volume[92913]: INFO cinder.volume.manager [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 24 09:44:23 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:44:23 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:44:23 devstack cinder-volume[92913]: DEBUG cinder.volume.drivers.quobyte [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=92913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:44:23 devstack cinder-volume[92913]: DEBUG cinder.volume.drivers.quobyte [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=92913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:44:23 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:44:23 devstack cinder-volume[92913]: DEBUG oslo_concurrency.processutils [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=92913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:44:23 devstack sudo[93023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:44:23 devstack sudo[93023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:44:24 devstack sudo[93023]: pam_unix(sudo:session): session closed for user root Jun 24 09:44:24 devstack cinder-volume[92913]: DEBUG oslo_concurrency.processutils [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.039s {{(pid=92913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:44:24 devstack cinder-volume[92913]: INFO cinder.volume.manager [None req-907f9db1-b53b-4a87-8e7e-13e1660df628 None None] Driver post RPC initialization completed successfully. Jun 24 09:44:27 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-9dda19ac-2abf-4281-891b-004c26dca834 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:44:27 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-9dda19ac-2abf-4281-891b-004c26dca834 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:44:27 devstack cinder-volume[92913]: DEBUG cinder.volume.drivers.quobyte [None req-9dda19ac-2abf-4281-891b-004c26dca834 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=92913) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:44:27 devstack cinder-volume[92913]: DEBUG cinder.volume.drivers.quobyte [None req-9dda19ac-2abf-4281-891b-004c26dca834 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=92913) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:44:27 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-9dda19ac-2abf-4281-891b-004c26dca834 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92913) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:44:27 devstack cinder-volume[92913]: DEBUG oslo_concurrency.processutils [None req-9dda19ac-2abf-4281-891b-004c26dca834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=92913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:44:27 devstack sudo[93113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:44:27 devstack sudo[93113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:44:28 devstack sudo[93113]: pam_unix(sudo:session): session closed for user root Jun 24 09:44:28 devstack cinder-volume[92913]: DEBUG oslo_concurrency.processutils [None req-9dda19ac-2abf-4281-891b-004c26dca834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.618s {{(pid=92913) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:44:28 devstack cinder-volume[92913]: DEBUG cinder.manager [None req-9dda19ac-2abf-4281-891b-004c26dca834 None None] Notifying Schedulers of capabilities ... {{(pid=92913) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:44:28 devstack cinder-volume[92913]: DEBUG oslo_service.periodic_task [None req-e46df79a-6afe-4d2a-a775-e95769add343 None None] Running periodic task VolumeManager._thread_info {{(pid=92913) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:44:28 devstack cinder-volume[92913]: DEBUG cinder.volume.manager [None req-e46df79a-6afe-4d2a-a775-e95769add343 None None] thread count: 6 {{(pid=92913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 09:44:28 devstack cinder-volume[92913]: DEBUG cinder.volume.manager [None req-e46df79a-6afe-4d2a-a775-e95769add343 None None] thread info: [<_MainThread(MainThread, started 129843738402944)>, , , , , ] {{(pid=92913) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 09:44:30 devstack cinder-volume[92698]: DEBUG dbcounter [-] [92698] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=92698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:44:30 devstack cinder-volume[92698]: INFO oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Caught SIGTERM, stopping children Jun 24 09:44:30 devstack cinder-volume[92698]: DEBUG oslo_concurrency.lockutils [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Acquiring lock "singleton_lock" {{(pid=92698) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 09:44:30 devstack cinder-volume[92698]: DEBUG oslo_concurrency.lockutils [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Acquired lock "singleton_lock" {{(pid=92698) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 09:44:30 devstack cinder-volume[92698]: DEBUG oslo_concurrency.lockutils [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Releasing lock "singleton_lock" {{(pid=92698) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 09:44:30 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Stop services. {{(pid=92698) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 24 09:44:30 devstack cinder-volume[92698]: DEBUG oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Killing children. {{(pid=92698) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 24 09:44:30 devstack cinder-volume[92698]: INFO oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Waiting on 1 children to exit Jun 24 09:44:31 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Acquiring lock "singleton_lock" {{(pid=92913) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 09:44:31 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Acquired lock "singleton_lock" {{(pid=92913) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 09:44:31 devstack cinder-volume[92913]: DEBUG oslo_concurrency.lockutils [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Releasing lock "singleton_lock" {{(pid=92913) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 09:44:31 devstack cinder-volume[92913]: WARNING amqp [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 24 09:44:31 devstack cinder-volume[92913]: WARNING amqp [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 24 09:44:31 devstack cinder-volume[92698]: INFO oslo_service.backend._eventlet.service [None req-02fb07a3-f040-49da-8a30-d1e1d5112c79 None None] Child 92913 exited with status 0 Jun 24 09:44:32 devstack cinder-volume[93189]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 24 09:44:32 devstack cinder-volume[93189]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 24 09:44:32 devstack cinder-volume[93189]: we strongly recommend against using it for new projects. Jun 24 09:44:32 devstack cinder-volume[93189]: If you are already using Eventlet, we recommend migrating to a different Jun 24 09:44:32 devstack cinder-volume[93189]: framework. For more detail see Jun 24 09:44:32 devstack cinder-volume[93189]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 24 09:44:32 devstack cinder-volume[93189]: import eventlet # noqa Jun 24 09:44:34 devstack cinder-volume[93189]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 24 09:44:34 devstack cinder-volume[93189]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 24 09:44:34 devstack cinder-volume[93189]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 24 09:44:35 devstack cinder-volume[93189]: INFO dbcounter [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] Registered counter for database cinder Jun 24 09:44:35 devstack cinder-volume[93189]: DEBUG oslo_db.sqlalchemy.engines [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93189) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG dbcounter [-] [93189] Writer thread running {{(pid=93189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 24 09:44:36 devstack cinder-volume[93189]: INFO cinder.rpc [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 24 09:44:36 devstack cinder-volume[93189]: INFO cinder.rpc [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_db.sqlalchemy.engines [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93189) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 09:44:36 devstack cinder-volume[93189]: INFO cinder.volume.manager [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] Determined volume DB was empty at startup. Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG cinder.volume.manager [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93189) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 24 09:44:36 devstack cinder-volume[93189]: WARNING stevedore.named [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 24 09:44:36 devstack cinder-volume[93189]: WARNING castellan.key_manager [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 09:44:36 devstack cinder-volume[93189]: WARNING cinder.keymgr.conf_key_mgr [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 24 09:44:36 devstack cinder-volume[93189]: INFO cinder.volume.manager [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_db.sqlalchemy.engines [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93189) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 09:44:36 devstack cinder-volume[93189]: INFO oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] Starting 1 workers Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] Started child 93447 {{(pid=93189) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 24 09:44:36 devstack cinder-volume[93447]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] Full set of CONF: {{(pid=93189) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] ******************************************************************************** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] Configuration options gathered from: {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] ================================================================================ {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] allow_availability_zone_fallback = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] allow_compression_on_image_upload = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] allowed_direct_url_schemes = [] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] api_rate_limit = True {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] auth_strategy = keystone {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_availability_zone = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_host = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_name = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_stats_polling_interval = 60 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backup_api_class = cinder.backup.api.API {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backup_name_template = backup-%s {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backup_use_same_host = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backup_use_temp_snapshot = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] chap_password = **** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] chap_username = {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cinder_internal_tenant_project_id = 4bc63da7d5e84172bac15e8cdfcfad02 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cinder_internal_tenant_user_id = 807b62122be142aca2955651a5299aba {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cluster = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] compression_format = gzip {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] compute_api_class = cinder.compute.nova.API {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] config_dir = [] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] config_source = [] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] control_exchange = openstack {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] debug = True {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] default_availability_zone = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] default_group_type = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] default_volume_type = QuobyteHD {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] disk_geometry = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] driver_client_cert = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] driver_client_cert_key = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] driver_data_namespace = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] driver_ssl_cert_path = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] driver_ssl_cert_verify = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] driver_use_ssl = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] enable_new_services = True {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] enable_unsupported_driver = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 24 09:44:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93447) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] enabled_backends = ['QuobyteHD'] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] enforce_multipath_for_image_xfer = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] filter_function = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] glance_api_insecure = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] glance_api_servers = ['http://192.168.122.237/image'] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] glance_api_ssl_compression = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] glance_ca_certificates_file = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] glance_catalog_info = image:glance:publicURL {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] glance_certfile = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] glance_keyfile = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] glance_num_retries = 3 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] glance_request_timeout = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] goodness_function = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] graceful_shutdown_timeout = 5 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] group_api_class = cinder.group.api.API {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] host = devstack {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] image_compress_on_upload = True {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] image_conversion_address_space_limit = 1 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] image_conversion_cpu_limit = 60 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] image_conversion_disable = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] image_upload_use_cinder_backend = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] image_upload_use_internal_tenant = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] image_volume_cache_enabled = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] image_volume_cache_max_count = 0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] image_volume_cache_max_size_gb = 0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] init_host_max_objects_retrieval = 0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] instance_format = [instance: %(uuid)s] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] iscsi_target_flags = {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] iscsi_write_cache = on {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] iser_helper = tgtadm {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] iser_ip_address = 192.168.122.237 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] iser_port = 3260 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] log_color = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] log_config_append = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] log_dir = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] log_file = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] log_options = True {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] log_rotate_interval = 1 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] log_rotate_interval_type = days {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] log_rotation_type = none {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:36 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] max_age = 0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] max_logfile_count = 30 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] max_logfile_size_mb = 200 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] max_over_subscription_ratio = 20.0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] message_reap_interval = 86400 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] message_ttl = 2592000 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] migration_create_volume_timeout_secs = 300 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] monkey_patch = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] monkey_patch_modules = [] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] my_ip = 192.168.122.237 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] no_snapshot_gb_quota = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] num_iser_scan_tries = 3 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] num_shell_tries = 3 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] num_volume_device_scan_tries = 3 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] nvmeof_conn_info_version = 1 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] nvmet_ns_id = 10 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] nvmet_port_id = 1 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] osapi_max_limit = 1000 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] osapi_volume_ext_list = [] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] osapi_volume_listen = 0.0.0.0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] osapi_volume_listen_port = 8776 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] osapi_volume_use_ssl = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] osapi_volume_workers = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] per_volume_size_limit = -1 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] periodic_fuzzy_delay = 60 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] periodic_interval = 60 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] project_id_regex = [0-9a-f\-]+ {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] public_endpoint = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] publish_errors = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] quota_backup_gigabytes = 1000 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] quota_backups = 10 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] quota_gigabytes = 1000 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93447) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] quota_groups = 10 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.quobyte [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] quota_snapshots = 10 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.quobyte [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] quota_volumes = 10 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] rate_limit_burst = 0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] rate_limit_except_level = CRITICAL {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] rate_limit_interval = 0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Running cmd (subprocess): mount.quobyte {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] reinit_driver_count = 3 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] replication_device = **** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] report_discard_supported = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] report_interval = 120 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] reservation_clean_interval = 86400 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] reservation_expire = 86400 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] reserved_image_namespaces = [] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] reserved_percentage = 0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] rpc_response_timeout = 120 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] run_external_periodic_tasks = True {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] scst_target_driver = iscsi {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] scst_target_iqn_name = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] service_down_time = 720 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] shell_completion = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] snapshot_name_template = snapshot-%s {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] split_loggers = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] state_path = /opt/stack/data/cinder {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] storage_availability_zone = nova {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] storage_protocol = iSCSI {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] syslog_log_facility = LOG_USER {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] target_helper = lioadm {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] target_ip_address = 192.168.122.237 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] target_port = 3260 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] target_protocol = iscsi {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] target_secondary_ip_addresses = [] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] trace_flags = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] transfer_api_class = cinder.transfer.api.API {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] transport_url = **** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] until_refresh = 0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] use_chap_auth = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] use_default_quota_class = True {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] use_journal = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] use_json = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] use_multipath_for_image_xfer = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] use_stderr = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] use_syslog = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] verify_glance_signatures = enabled {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] volume_api_class = cinder.volume.api.API {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] volume_backend_name = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] volume_clear = zero {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] volume_clear_ionice = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] volume_clear_size = 0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] volume_copy_bps_limit = 0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] volume_dd_blocksize = 1M {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] volume_name_template = volume-%s {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] volume_service_inithost_offload = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] volume_usage_audit_period = month {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] zoning_mode = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_concurrency.disable_process_locking = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.auth_section = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.auth_type = password {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.auth_version = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.cache = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.certfile = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.delay_auth_decision = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.http_connect_timeout = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.include_service_catalog = True {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.insecure = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.interface = public {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.keyfile = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.memcache_password = {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.memcache_username = {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.region_name = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.service_token_roles_required = True {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.service_type = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.token_cache_time = 300 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.237/identity {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.backend = dogpile.cache.null {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.backend_argument = **** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.backend_expiration_time = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.config_prefix = cache.oslo {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.debug_cache_backend = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.enable_retry_client = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.enable_socket_keepalive = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.enabled = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.expiration_time = 600 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.hashclient_retry_attempts = 2 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.memcache_dead_retry = 300 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack quobyte-client[93449]: Reading configuration file: /etc/quobyte/client.cfg Jun 24 09:44:37 devstack quobyte-client[93449]: Invalid parameters found, error: missing mount point. Jun 24 09:44:37 devstack quobyte-client[93449]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.memcache_pool_maxsize = 10 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack quobyte-client[93449]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.memcache_sasl_enabled = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.password = **** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.proxies = [] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.redis_db = 0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.redis_sentinel_service_name = mymaster {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.redis_server = localhost:6379 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.retry_attempts = 2 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.retry_delay = 0.0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.socket_keepalive_count = 1 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] CMD "mount.quobyte" returned: 1 in 0.108s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.socket_keepalive_idle = 1 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.socket_keepalive_interval = 1 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.socket_timeout = 1.0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.tls_allowed_ciphers = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.tls_cafile = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.tls_certfile = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.tls_enabled = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.tls_keyfile = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cache.username = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] coordination.backend_url = **** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] database.asyncio_connection = **** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] database.asyncio_slave_connection = **** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] database.backend = sqlalchemy {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] database.connection = **** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] database.connection_debug = 0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] database.connection_parameters = {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] database.connection_recycle_time = 3600 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] database.connection_trace = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] database.db_inc_retry_interval = True {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] database.db_max_retries = 20 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] database.db_max_retry_interval = 10 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] database.db_retry_interval = 1 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] database.max_overflow = 50 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] database.max_pool_size = 5 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] database.max_retries = 10 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] database.mysql_wsrep_sync_wait = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] database.pool_timeout = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] database.retry_interval = 10 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] database.slave_connection = **** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] database.sqlite_synchronous = True {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] database.synchronous_reader = True {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] database.use_db_reconnect = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] profiler.connection_string = messaging:// {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] profiler.enabled = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] profiler.es_doc_type = notification {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] profiler.es_scroll_size = 10000 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] profiler.es_scroll_time = 2m {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] profiler.filter_error_trace = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] profiler.hmac_keys = **** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] profiler.sentinel_service_name = mymaster {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] profiler.socket_timeout = 0.1 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] profiler.trace_requests = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] profiler.trace_sqlalchemy = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] profiler_jaeger.process_tags = {} {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] profiler_jaeger.service_name_prefix = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] profiler_otlp.service_name_prefix = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_policy.enforce_new_defaults = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: WARNING oslo_config.cfg [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_policy.enforce_scope = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_policy.policy_default_rule = default {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_policy.policy_file = policy.yaml {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_policy.remote_timeout = 60.0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] privsep_osbrick.group = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] privsep_osbrick.helper_command = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] privsep_osbrick.user = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cinder_sys_admin.group = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cinder_sys_admin.helper_command = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] cinder_sys_admin.user = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] service_user.auth_section = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] service_user.auth_type = password {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] service_user.cafile = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] service_user.certfile = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] service_user.collect_timing = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] service_user.insecure = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] service_user.keyfile = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] service_user.send_service_user_token = True {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] service_user.split_loggers = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] service_user.timeout = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] glance.auth_section = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] glance.auth_type = password {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] glance.certfile = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] glance.collect_timing = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] glance.insecure = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] glance.keyfile = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] glance.region_name = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] glance.split_loggers = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] glance.timeout = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.backend_availability_zone = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.chap_password = **** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.chap_username = {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.disk_geometry = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.driver_client_cert = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.driver_client_cert_key = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.driver_data_namespace = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.driver_use_ssl = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.enable_unsupported_driver = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.extra_capabilities = {} {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.filter_function = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.goodness_function = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.iscsi_target_flags = {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.iscsi_write_cache = on {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.iser_helper = tgtadm {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.iser_ip_address = 192.168.122.237 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.iser_port = 3260 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.nas_host = {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.nas_login = admin {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.nas_mount_options = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.nas_password = **** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.nas_private_key = {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.nas_share_path = {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.nas_ssh_port = 22 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.num_shell_tries = 3 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.nvmet_port_id = 1 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.quobyte_client_cfg = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.quobyte_volume_url = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.replication_device = **** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.report_discard_supported = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.reserved_percentage = 0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.scst_target_driver = iscsi {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack sudo[93463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.scst_target_iqn_name = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.storage_protocol = iSCSI {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack sudo[93463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.target_helper = tgtadm {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.target_ip_address = 192.168.122.237 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.target_port = 3260 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.target_protocol = iscsi {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.trace_flags = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.unique_fqdn_network = True {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.use_chap_auth = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.volume_backend_name = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.volume_clear = zero {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.volume_clear_ionice = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.volume_clear_size = 0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_reports.file_event_handler = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_reports.log_dir = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.backend_availability_zone = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.backend_host = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.chap_password = **** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.chap_username = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.chiscsi_conf = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.disk_geometry = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.driver_client_cert = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.driver_client_cert_key = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.driver_data_namespace = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.driver_use_ssl = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.extra_capabilities = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.filter_function = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.goodness_function = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.iscsi_target_flags = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.iscsi_write_cache = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.iser_helper = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.iser_ip_address = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.iser_port = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.iser_target_prefix = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.nas_host = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.nas_login = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.nas_mount_options = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.nas_password = **** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.nas_private_key = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.nas_share_path = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.nas_ssh_port = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.num_shell_tries = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.nvmet_ns_id = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.nvmet_port_id = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.replication_device = **** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.report_discard_supported = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.reserved_percentage = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.scst_target_driver = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.storage_protocol = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.target_helper = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.target_ip_address = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.target_port = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.target_prefix = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.target_protocol = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.trace_flags = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.unique_fqdn_network = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.use_chap_auth = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.volume_clear = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.volume_clear_ionice = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.volume_clear_size = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] QuobyteHD.volumes_dir = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.ssl = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.ssl_version = {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_notifications.driver = [] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_notifications.retry = -1 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] oslo_messaging_notifications.transport_url = **** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] key_manager.fixed_key = **** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican.barbican_api_version = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican.barbican_endpoint = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican.barbican_endpoint_type = public {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican.barbican_region_name = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican.cafile = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican.certfile = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican.collect_timing = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican.insecure = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican.keyfile = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican.number_of_retries = 60 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican.retry_delay = 1 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican.send_service_user_token = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican.split_loggers = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican.timeout = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican.verify_ssl = True {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican.verify_ssl_path = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican_service_user.auth_section = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican_service_user.auth_type = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican_service_user.cafile = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican_service_user.certfile = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican_service_user.collect_timing = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican_service_user.insecure = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican_service_user.keyfile = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican_service_user.split_loggers = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] barbican_service_user.timeout = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] vault.approle_role_id = **** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] vault.approle_secret_id = **** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] vault.kv_mountpoint = secret {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] vault.kv_path = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] vault.kv_version = 2 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] vault.namespace = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] vault.root_token_id = **** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] vault.ssl_ca_crt_file = None {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] vault.timeout = 60.0 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] vault.use_ssl = False {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 24 09:44:37 devstack cinder-volume[93189]: DEBUG oslo_service.backend._eventlet.service [None req-74aae43d-734a-4b1f-be15-775f4bd2818a None None] ******************************************************************************** {{(pid=93189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 24 09:44:38 devstack sudo[93463]: pam_unix(sudo:session): session closed for user root Jun 24 09:44:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.102s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:44:38 devstack cinder-volume[93447]: INFO cinder.volume.driver [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Driver hasn't implemented _init_vendor_properties() Jun 24 09:44:38 devstack cinder-volume[93447]: DEBUG cinder.volume.driver [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.737678527832, 'free_capacity_gb': 1775.737678527832, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93447) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 24 09:44:38 devstack cinder-volume[93447]: DEBUG oslo_db.sqlalchemy.engines [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93447) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 24 09:44:38 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writer thread running {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 24 09:44:38 devstack cinder-volume[93447]: DEBUG cinder.db.api [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Building query based on filter {{(pid=93447) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 24 09:44:38 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93447) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 24 09:44:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:44:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:44:38 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:44:38 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:44:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:44:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:44:38 devstack cinder-volume[93447]: INFO cinder.keymgr.migration [None req-f41bcf70-a98e-4149-b4ca-250b73df0818 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 24 09:44:38 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:44:38 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:44:39 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Jun 24 09:44:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.681s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:44:39 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:44:39 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Driver initialization completed successfully. Jun 24 09:44:39 devstack cinder-volume[93447]: INFO cinder.manager [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Initiating service 3 cleanup Jun 24 09:44:39 devstack cinder-volume[93447]: INFO cinder.manager [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Service 3 cleanup completed. Jun 24 09:44:39 devstack cinder-volume[93447]: DEBUG cinder.service [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Creating RPC server for service cinder-volume {{(pid=93447) start /opt/stack/cinder/cinder/service.py:231}} Jun 24 09:44:39 devstack cinder-volume[93447]: DEBUG cinder.service [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93447) start /opt/stack/cinder/cinder/service.py:237}} Jun 24 09:44:39 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 24 09:44:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:44:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:44:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:44:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:44:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:44:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:44:39 devstack sudo[93503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:44:39 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:44:39 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root Jun 24 09:44:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.622s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:44:39 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-049927da-5aae-46e1-8b78-3b7b358b7214 None None] Driver post RPC initialization completed successfully. Jun 24 09:44:46 devstack cinder-volume[93189]: DEBUG dbcounter [-] [93189] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:44:49 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:44:49 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=3 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:45:24 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:45:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 6 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 09:45:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 09:46:13 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:46:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Flow 'volume_create_manager' (980216a8-828f-4583-a32c-82e67d96b8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:46:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f20417-7326-4ef1-bb27-6657958cdd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f20417-7326-4ef1-bb27-6657958cdd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-259838195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161fd9f6-62f2-4a15-ba98-179f23aea7ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c631ae657514b2a9e4fd46274130cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:46:13Z,use_quota=True,user_id='f20af48f87a44ee69477cb6f9d4f571b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b808bcc6-9c48-431c-a455-feb1f2e4e083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b808bcc6-9c48-431c-a455-feb1f2e4e083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f76fe141-dc68-4d6e-b41a-405bfeac1c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f76fe141-dc68-4d6e-b41a-405bfeac1c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '161fd9f6-62f2-4a15-ba98-179f23aea7ed', 'volume_name': 'volume-161fd9f6-62f2-4a15-ba98-179f23aea7ed', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5fcd9e-a671-42d6-b097-e7acf1934af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5fcd9e-a671-42d6-b097-e7acf1934af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac1cd78f-fc12-4619-8465-b846901d79ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:13 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Volume 161fd9f6-62f2-4a15-ba98-179f23aea7ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-161fd9f6-62f2-4a15-ba98-179f23aea7ed', 'volume_size': 1} Jun 24 09:46:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:46:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:46:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-259838195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161fd9f6-62f2-4a15-ba98-179f23aea7ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c631ae657514b2a9e4fd46274130cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:46:13Z,use_quota=True,user_id='f20af48f87a44ee69477cb6f9d4f571b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:46:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Creating volume 161fd9f6-62f2-4a15-ba98-179f23aea7ed {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:46:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:46:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:46:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:46:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:46:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:46:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:46:13 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:46:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-161fd9f6-62f2-4a15-ba98-179f23aea7ed 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:46:13 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-161fd9f6-62f2-4a15-ba98-179f23aea7ed 1073741824 Jun 24 09:46:13 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:46:15 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Jun 24 09:46:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-161fd9f6-62f2-4a15-ba98-179f23aea7ed 1073741824" returned: 0 in 1.457s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:46:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-161fd9f6-62f2-4a15-ba98-179f23aea7ed {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:46:15 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-161fd9f6-62f2-4a15-ba98-179f23aea7ed Jun 24 09:46:15 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:46:16 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Jun 24 09:46:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-161fd9f6-62f2-4a15-ba98-179f23aea7ed" returned: 0 in 0.876s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:46:16 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] <== create_volume: return (2405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:46:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.408s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:46:16 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac1cd78f-fc12-4619-8465-b846901d79ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-161fd9f6-62f2-4a15-ba98-179f23aea7ed', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:16 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f72f3af-857c-4747-8a46-a40e4bc46e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:16 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Volume volume-161fd9f6-62f2-4a15-ba98-179f23aea7ed (161fd9f6-62f2-4a15-ba98-179f23aea7ed): created successfully Jun 24 09:46:16 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f72f3af-857c-4747-8a46-a40e4bc46e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:16 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Flow 'volume_create_manager' (980216a8-828f-4583-a32c-82e67d96b8f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:46:16 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-413a5edf-ba80-407c-8729-6cb40260b4fd tempest-VolumesAdminNegativeTest-1006509623 None] Created volume successfully. Jun 24 09:46:18 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] Acquiring lock "cinder-161fd9f6-62f2-4a15-ba98-179f23aea7ed-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:46:18 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] Lock "cinder-161fd9f6-62f2-4a15-ba98-179f23aea7ed-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:46:18 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] Acquiring lock "cinder-quobyte-161fd9f6-62f2-4a15-ba98-179f23aea7ed" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:46:18 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] Lock "cinder-quobyte-161fd9f6-62f2-4a15-ba98-179f23aea7ed" acquired by "delete_volume" :: waited 0.046s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:46:18 devstack cinder-volume[93447]: INFO oslo.privsep.daemon [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpq0o1hrgb/privsep.sock'] Jun 24 09:46:18 devstack sudo[94794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpq0o1hrgb/privsep.sock Jun 24 09:46:18 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:46:19 devstack cinder-volume[93447]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 24 09:46:19 devstack cinder-volume[93447]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 24 09:46:19 devstack cinder-volume[93447]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 24 09:46:19 devstack cinder-volume[93447]: WARNING oslo.privsep.daemon [-] privsep log: Jun 24 09:46:19 devstack cinder-volume[93447]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 24 09:46:19 devstack cinder-volume[93447]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 24 09:46:19 devstack cinder-volume[93447]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 24 09:46:19 devstack cinder-volume[93447]: WARNING oslo.privsep.daemon [-] privsep log: Jun 24 09:46:19 devstack cinder-volume[93447]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 24 09:46:20 devstack cinder-volume[93447]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 24 09:46:20 devstack cinder-volume[93447]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 24 09:46:20 devstack cinder-volume[93447]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 24 09:46:20 devstack cinder-volume[93447]: WARNING oslo.privsep.daemon [-] privsep log: Jun 24 09:46:20 devstack cinder-volume[93447]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 24 09:46:20 devstack cinder-volume[93447]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 24 09:46:20 devstack cinder-volume[93447]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 24 09:46:20 devstack cinder-volume[93447]: WARNING oslo.privsep.daemon [-] privsep log: Jun 24 09:46:20 devstack cinder-volume[93447]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 24 09:46:21 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root Jun 24 09:46:21 devstack cinder-volume[93447]: INFO oslo.privsep.daemon [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] Spawned new privsep daemon via rootwrap Jun 24 09:46:21 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] Accepted privsep connection to /tmp/tmpq0o1hrgb/privsep.sock {{(pid=93447) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 24 09:46:21 devstack cinder-volume[93447]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 24 09:46:21 devstack cinder-volume[93447]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 24 09:46:21 devstack cinder-volume[93447]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 24 09:46:21 devstack cinder-volume[93447]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 94801 Jun 24 09:46:21 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[329c575a-1b43-4c69-aa9c-8d0b3d1463c4]: (2,) {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:46:21 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c72330a-aab0-4efb-ae78-710bfd672a98]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:46:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-161fd9f6-62f2-4a15-ba98-179f23aea7ed {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:46:21 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-161fd9f6-62f2-4a15-ba98-179f23aea7ed Jun 24 09:46:21 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:46:23 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Jun 24 09:46:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-161fd9f6-62f2-4a15-ba98-179f23aea7ed" returned: 0 in 2.426s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:46:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-161fd9f6-62f2-4a15-ba98-179f23aea7ed {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:46:23 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-161fd9f6-62f2-4a15-ba98-179f23aea7ed Jun 24 09:46:23 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Flow 'volume_create_manager' (8857917e-ca0e-4eea-9a73-1dbe03f174e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b46278d-10e2-4217-bf6b-77b91ece817f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b46278d-10e2-4217-bf6b-77b91ece817f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-601442228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=563aa654-5811-4740-a41d-6f65eb163b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2bffd832e64e4eb0935f3d394cad33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:46:25Z,use_quota=True,user_id='b57e155b3eb54e6db952f68a5122ccc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb450af-bd47-496b-af41-15649684c462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb450af-bd47-496b-af41-15649684c462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e0bb95-b768-4889-9e07-cf9a74b446fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e0bb95-b768-4889-9e07-cf9a74b446fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '563aa654-5811-4740-a41d-6f65eb163b2e', 'volume_name': 'volume-563aa654-5811-4740-a41d-6f65eb163b2e', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3634b1b-15bf-4101-9f56-dbf539a72166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3634b1b-15bf-4101-9f56-dbf539a72166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b77a12a-2e81-4ac3-9733-51408f7ac9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:24 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Volume 563aa654-5811-4740-a41d-6f65eb163b2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-563aa654-5811-4740-a41d-6f65eb163b2e', 'volume_size': 1} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-601442228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=563aa654-5811-4740-a41d-6f65eb163b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2bffd832e64e4eb0935f3d394cad33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:46:25Z,use_quota=True,user_id='b57e155b3eb54e6db952f68a5122ccc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Creating volume 563aa654-5811-4740-a41d-6f65eb163b2e {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:46:24 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-563aa654-5811-4740-a41d-6f65eb163b2e 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:46:24 devstack sudo[94869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-563aa654-5811-4740-a41d-6f65eb163b2e 1073741824 Jun 24 09:46:24 devstack sudo[94869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:46:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:46:25 devstack sudo[94871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:46:25 devstack sudo[94871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:46:25 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Jun 24 09:46:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-161fd9f6-62f2-4a15-ba98-179f23aea7ed" returned: 0 in 1.561s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:46:25 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] Lock "cinder-quobyte-161fd9f6-62f2-4a15-ba98-179f23aea7ed" released by "delete_volume" :: held 6.961s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:46:25 devstack cinder-volume[93447]: WARNING cinder.quota [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:46:25 devstack cinder-volume[93447]: WARNING cinder.quota [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:46:25 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] Created reservations ['f69ff5e6-a900-437c-8450-6d6d3091c2aa', '18ef2b3e-c881-4c44-a663-a07b01d85818', '77008954-00c3-45fd-9c5a-b74313a2c5e6', '5412d7f3-37f4-4fe8-b5b0-43f819697a81'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:46:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:46:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:46:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:46:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:46:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:46:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:46:26 devstack sudo[94871]: pam_unix(sudo:session): session closed for user root Jun 24 09:46:26 devstack sudo[94907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:46:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.251s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:46:26 devstack sudo[94907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:46:26 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:46:26 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:46:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 8 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 09:46:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 09:46:27 devstack sudo[94869]: pam_unix(sudo:session): session closed for user root Jun 24 09:46:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-563aa654-5811-4740-a41d-6f65eb163b2e 1073741824" returned: 0 in 2.563s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:46:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-563aa654-5811-4740-a41d-6f65eb163b2e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:46:27 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-563aa654-5811-4740-a41d-6f65eb163b2e Jun 24 09:46:27 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:46:27 devstack sudo[94907]: pam_unix(sudo:session): session closed for user root Jun 24 09:46:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.694s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:46:27 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:46:27 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] Deleted volume successfully. Jun 24 09:46:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f5cf2bbf-5d17-4685-a413-e57932d30281 tempest-VolumesAdminNegativeTest-1006509623 None] Lock "cinder-161fd9f6-62f2-4a15-ba98-179f23aea7ed-delete_volume" released by "delete_volume" :: held 9.682s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:46:28 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Jun 24 09:46:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-563aa654-5811-4740-a41d-6f65eb163b2e" returned: 0 in 0.861s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:46:28 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] <== create_volume: return (3576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:46:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.579s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:46:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b77a12a-2e81-4ac3-9733-51408f7ac9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-563aa654-5811-4740-a41d-6f65eb163b2e', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87620dbb-f43b-46f4-80c5-f15e7cb15d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:28 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Volume volume-563aa654-5811-4740-a41d-6f65eb163b2e (563aa654-5811-4740-a41d-6f65eb163b2e): created successfully Jun 24 09:46:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87620dbb-f43b-46f4-80c5-f15e7cb15d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Flow 'volume_create_manager' (8857917e-ca0e-4eea-9a73-1dbe03f174e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:46:28 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-d09ab524-a8ca-4b90-bf41-1af22a11e288 tempest-ServerActionsTestOtherA-2061493000 None] Created volume successfully. Jun 24 09:46:38 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:UPDATE=13,cinder:SELECT=6,cinder:INSERT=3,cinder:DELETE=1 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:46:38 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=12,cinder:UPDATE=15,cinder:INSERT=3,cinder:DELETE=2 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:46:42 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:46:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Flow 'volume_create_manager' (27e4e24e-9a81-4fd0-8eeb-613723013190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:46:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aeaf82a-8fdc-4f2a-880c-36c052a2f7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aeaf82a-8fdc-4f2a-880c-36c052a2f7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-441783143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d76e9e2-2292-47e0-86c8-af8abf29ee45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7528ba6c4ebc479ab40d0c046923b839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:46:43Z,use_quota=True,user_id='e14dccefa77249a3a5a1488467bc0aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4cf3c94-ad1d-4ead-8f17-c61817afa63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4cf3c94-ad1d-4ead-8f17-c61817afa63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c801d7d1-1bda-4e2b-850b-2799e03ae118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c801d7d1-1bda-4e2b-850b-2799e03ae118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d76e9e2-2292-47e0-86c8-af8abf29ee45', 'volume_name': 'volume-9d76e9e2-2292-47e0-86c8-af8abf29ee45', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29486cab-8676-45a3-92bb-7d6ef69a52f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29486cab-8676-45a3-92bb-7d6ef69a52f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3743032-7551-4d21-9cd3-d7bf2c3e402d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:42 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Volume 9d76e9e2-2292-47e0-86c8-af8abf29ee45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d76e9e2-2292-47e0-86c8-af8abf29ee45', 'volume_size': 1} Jun 24 09:46:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:46:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:46:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-441783143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d76e9e2-2292-47e0-86c8-af8abf29ee45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7528ba6c4ebc479ab40d0c046923b839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:46:43Z,use_quota=True,user_id='e14dccefa77249a3a5a1488467bc0aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:46:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Creating volume 9d76e9e2-2292-47e0-86c8-af8abf29ee45 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:46:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:46:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:46:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:46:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:46:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:46:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:46:42 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:46:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9d76e9e2-2292-47e0-86c8-af8abf29ee45 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:46:42 devstack sudo[95078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9d76e9e2-2292-47e0-86c8-af8abf29ee45 1073741824 Jun 24 09:46:42 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:46:43 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root Jun 24 09:46:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9d76e9e2-2292-47e0-86c8-af8abf29ee45 1073741824" returned: 0 in 0.891s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:46:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9d76e9e2-2292-47e0-86c8-af8abf29ee45 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:46:43 devstack sudo[95085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9d76e9e2-2292-47e0-86c8-af8abf29ee45 Jun 24 09:46:43 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:46:44 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root Jun 24 09:46:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9d76e9e2-2292-47e0-86c8-af8abf29ee45" returned: 0 in 0.685s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:46:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:46:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:46:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3743032-7551-4d21-9cd3-d7bf2c3e402d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d76e9e2-2292-47e0-86c8-af8abf29ee45', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193fcf80-1670-466b-a194-39bc0bbf1913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:44 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Volume volume-9d76e9e2-2292-47e0-86c8-af8abf29ee45 (9d76e9e2-2292-47e0-86c8-af8abf29ee45): created successfully Jun 24 09:46:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193fcf80-1670-466b-a194-39bc0bbf1913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Flow 'volume_create_manager' (27e4e24e-9a81-4fd0-8eeb-613723013190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:46:44 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-9c76d610-9b9b-4686-978a-4631694e0f76 tempest-ServersNegativeTestJSON-866000907 None] Created volume successfully. Jun 24 09:46:49 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:46:49 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Flow 'volume_create_manager' (28bcd08b-6d6f-4738-bcef-aa79d73db50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:46:49 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f79b840-c017-4ee3-af10-2a2b83a86058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:49 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f79b840-c017-4ee3-af10-2a2b83a86058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1312592343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea273271-0317-43d3-bfdc-50cbe8a43b92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7528ba6c4ebc479ab40d0c046923b839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:46:49Z,use_quota=True,user_id='e14dccefa77249a3a5a1488467bc0aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:49 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02b8762-8987-40e0-8371-f4a46245e6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:49 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02b8762-8987-40e0-8371-f4a46245e6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:49 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ff9e3c-d330-4e90-8bd0-1499980ca66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:49 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ff9e3c-d330-4e90-8bd0-1499980ca66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea273271-0317-43d3-bfdc-50cbe8a43b92', 'volume_name': 'volume-ea273271-0317-43d3-bfdc-50cbe8a43b92', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:49 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66d217b-21c7-43b5-bb8a-ae2c3d5e68e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:49 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66d217b-21c7-43b5-bb8a-ae2c3d5e68e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:49 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fdee44-c014-4661-9068-3e7f0d091361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:49 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Volume ea273271-0317-43d3-bfdc-50cbe8a43b92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea273271-0317-43d3-bfdc-50cbe8a43b92', 'volume_size': 1} Jun 24 09:46:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:46:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:46:49 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1312592343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea273271-0317-43d3-bfdc-50cbe8a43b92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7528ba6c4ebc479ab40d0c046923b839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:46:49Z,use_quota=True,user_id='e14dccefa77249a3a5a1488467bc0aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:46:49 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Creating volume ea273271-0317-43d3-bfdc-50cbe8a43b92 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:46:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:46:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:46:49 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:46:49 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:46:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:46:49 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:46:49 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:46:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea273271-0317-43d3-bfdc-50cbe8a43b92 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:46:49 devstack sudo[95263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea273271-0317-43d3-bfdc-50cbe8a43b92 1073741824 Jun 24 09:46:49 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:46:50 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:46:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Flow 'volume_create_manager' (d512b539-eba8-4276-ba73-d113318f1b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:46:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f76399a-1e49-47d2-9dec-e10fa8c0626e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f76399a-1e49-47d2-9dec-e10fa8c0626e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-546392771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff8c842-1bed-4115-a4c1-6da15c362f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0d18a98d9f4b19b6293212ea00443b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:46:51Z,use_quota=True,user_id='11df02ad4b0846ba96c8d787bcf67bd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de15dfb2-e5f0-4653-a87b-e913b7cc1f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de15dfb2-e5f0-4653-a87b-e913b7cc1f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0e58b5-3760-4b0a-97aa-f344235c80b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0e58b5-3760-4b0a-97aa-f344235c80b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eff8c842-1bed-4115-a4c1-6da15c362f5b', 'volume_name': 'volume-eff8c842-1bed-4115-a4c1-6da15c362f5b', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e603ddb-4710-4a74-81cc-9135f0ce766f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e603ddb-4710-4a74-81cc-9135f0ce766f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4a2e078-8adb-4cd7-94f7-01ec6a7d2aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:50 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Volume eff8c842-1bed-4115-a4c1-6da15c362f5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eff8c842-1bed-4115-a4c1-6da15c362f5b', 'volume_size': 1} Jun 24 09:46:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:46:50 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root Jun 24 09:46:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea273271-0317-43d3-bfdc-50cbe8a43b92 1073741824" returned: 0 in 1.476s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:46:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea273271-0317-43d3-bfdc-50cbe8a43b92 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:46:51 devstack sudo[95273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea273271-0317-43d3-bfdc-50cbe8a43b92 Jun 24 09:46:51 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:46:52 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root Jun 24 09:46:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea273271-0317-43d3-bfdc-50cbe8a43b92" returned: 0 in 1.238s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:46:52 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] <== create_volume: return (2788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:46:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.791s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:46:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.443s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:46:52 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-546392771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff8c842-1bed-4115-a4c1-6da15c362f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0d18a98d9f4b19b6293212ea00443b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:46:51Z,use_quota=True,user_id='11df02ad4b0846ba96c8d787bcf67bd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:46:52 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Creating volume eff8c842-1bed-4115-a4c1-6da15c362f5b {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:46:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:46:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:46:52 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:46:52 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:46:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:46:52 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:46:52 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:46:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eff8c842-1bed-4115-a4c1-6da15c362f5b 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:46:52 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fdee44-c014-4661-9068-3e7f0d091361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea273271-0317-43d3-bfdc-50cbe8a43b92', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:52 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eff8c842-1bed-4115-a4c1-6da15c362f5b 1073741824 Jun 24 09:46:52 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:46:52 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49fbe5a-84bf-4c34-84f5-b2cc11cc8f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:52 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Volume volume-ea273271-0317-43d3-bfdc-50cbe8a43b92 (ea273271-0317-43d3-bfdc-50cbe8a43b92): created successfully Jun 24 09:46:52 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49fbe5a-84bf-4c34-84f5-b2cc11cc8f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:52 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Flow 'volume_create_manager' (28bcd08b-6d6f-4738-bcef-aa79d73db50d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:46:52 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-085d2be9-c3ca-4b3f-a1ea-7a45378fb189 tempest-ServersNegativeTestJSON-866000907 None] Created volume successfully. Jun 24 09:46:54 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Jun 24 09:46:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eff8c842-1bed-4115-a4c1-6da15c362f5b 1073741824" returned: 0 in 2.006s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:46:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eff8c842-1bed-4115-a4c1-6da15c362f5b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:46:54 devstack sudo[95286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eff8c842-1bed-4115-a4c1-6da15c362f5b Jun 24 09:46:54 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:46:55 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d198b8e3-29fc-4f30-8a34-09d5d1427cf8 tempest-ServersNegativeTestJSON-866000907 None] Acquiring lock "cinder-ea273271-0317-43d3-bfdc-50cbe8a43b92-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:46:55 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d198b8e3-29fc-4f30-8a34-09d5d1427cf8 tempest-ServersNegativeTestJSON-866000907 None] Lock "cinder-ea273271-0317-43d3-bfdc-50cbe8a43b92-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:46:55 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d198b8e3-29fc-4f30-8a34-09d5d1427cf8 tempest-ServersNegativeTestJSON-866000907 None] Acquiring lock "cinder-quobyte-ea273271-0317-43d3-bfdc-50cbe8a43b92" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:46:55 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d198b8e3-29fc-4f30-8a34-09d5d1427cf8 tempest-ServersNegativeTestJSON-866000907 None] Lock "cinder-quobyte-ea273271-0317-43d3-bfdc-50cbe8a43b92" acquired by "delete_volume" :: waited 0.021s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:46:55 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[47156c5f-b801-4ca8-8378-1509869be5fa]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:46:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d198b8e3-29fc-4f30-8a34-09d5d1427cf8 tempest-ServersNegativeTestJSON-866000907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea273271-0317-43d3-bfdc-50cbe8a43b92 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:46:55 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root Jun 24 09:46:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eff8c842-1bed-4115-a4c1-6da15c362f5b" returned: 0 in 1.383s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:46:55 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] <== create_volume: return (3451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:46:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.456s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:46:55 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4a2e078-8adb-4cd7-94f7-01ec6a7d2aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eff8c842-1bed-4115-a4c1-6da15c362f5b', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:55 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42d7deb-c03e-4ca3-b267-e29a6c42bd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:46:55 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Volume volume-eff8c842-1bed-4115-a4c1-6da15c362f5b (eff8c842-1bed-4115-a4c1-6da15c362f5b): created successfully Jun 24 09:46:55 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42d7deb-c03e-4ca3-b267-e29a6c42bd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:46:55 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Flow 'volume_create_manager' (d512b539-eba8-4276-ba73-d113318f1b5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:46:55 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-63e98cf1-450c-4641-8228-2f17e468f30c tempest-DeleteServersTestJSON-862633273 None] Created volume successfully. Jun 24 09:46:55 devstack sudo[95292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea273271-0317-43d3-bfdc-50cbe8a43b92 Jun 24 09:46:55 devstack sudo[95292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:46:57 devstack sudo[95292]: pam_unix(sudo:session): session closed for user root Jun 24 09:46:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d198b8e3-29fc-4f30-8a34-09d5d1427cf8 tempest-ServersNegativeTestJSON-866000907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea273271-0317-43d3-bfdc-50cbe8a43b92" returned: 0 in 1.476s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:46:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d198b8e3-29fc-4f30-8a34-09d5d1427cf8 tempest-ServersNegativeTestJSON-866000907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea273271-0317-43d3-bfdc-50cbe8a43b92 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:46:57 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea273271-0317-43d3-bfdc-50cbe8a43b92 Jun 24 09:46:57 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:46:58 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Jun 24 09:46:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d198b8e3-29fc-4f30-8a34-09d5d1427cf8 tempest-ServersNegativeTestJSON-866000907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea273271-0317-43d3-bfdc-50cbe8a43b92" returned: 0 in 0.933s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:46:58 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d198b8e3-29fc-4f30-8a34-09d5d1427cf8 tempest-ServersNegativeTestJSON-866000907 None] Lock "cinder-quobyte-ea273271-0317-43d3-bfdc-50cbe8a43b92" released by "delete_volume" :: held 2.511s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:46:58 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-d198b8e3-29fc-4f30-8a34-09d5d1427cf8 tempest-ServersNegativeTestJSON-866000907 None] Created reservations ['4b29e89b-bdca-48ff-b644-98c29e299e3e', '7664aab4-d05b-4990-b6b9-5a68d95a47fc', '8a0c45d1-76bf-4175-a5f3-c86ae4578a1e', 'd1dec230-a1ec-451f-8ec6-f5e312e1da6b'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:46:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d198b8e3-29fc-4f30-8a34-09d5d1427cf8 tempest-ServersNegativeTestJSON-866000907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:46:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d198b8e3-29fc-4f30-8a34-09d5d1427cf8 tempest-ServersNegativeTestJSON-866000907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:46:58 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d198b8e3-29fc-4f30-8a34-09d5d1427cf8 tempest-ServersNegativeTestJSON-866000907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:46:58 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d198b8e3-29fc-4f30-8a34-09d5d1427cf8 tempest-ServersNegativeTestJSON-866000907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:46:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d198b8e3-29fc-4f30-8a34-09d5d1427cf8 tempest-ServersNegativeTestJSON-866000907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:46:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d198b8e3-29fc-4f30-8a34-09d5d1427cf8 tempest-ServersNegativeTestJSON-866000907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:46:58 devstack sudo[95306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:46:58 devstack sudo[95306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:46:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-28f8809a-811b-47f4-91c8-f3f4aa0a1b15 tempest-ServersNegativeTestJSON-866000907 None] Acquiring lock "cinder-9d76e9e2-2292-47e0-86c8-af8abf29ee45-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:46:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-28f8809a-811b-47f4-91c8-f3f4aa0a1b15 tempest-ServersNegativeTestJSON-866000907 None] Lock "cinder-9d76e9e2-2292-47e0-86c8-af8abf29ee45-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:46:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-28f8809a-811b-47f4-91c8-f3f4aa0a1b15 tempest-ServersNegativeTestJSON-866000907 None] Acquiring lock "cinder-quobyte-9d76e9e2-2292-47e0-86c8-af8abf29ee45" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:46:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-28f8809a-811b-47f4-91c8-f3f4aa0a1b15 tempest-ServersNegativeTestJSON-866000907 None] Lock "cinder-quobyte-9d76e9e2-2292-47e0-86c8-af8abf29ee45" acquired by "delete_volume" :: waited 0.042s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:46:59 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3367bf97-f6ca-4a36-a3d0-f9ae5f2f4ac2]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:46:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-28f8809a-811b-47f4-91c8-f3f4aa0a1b15 tempest-ServersNegativeTestJSON-866000907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9d76e9e2-2292-47e0-86c8-af8abf29ee45 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:46:59 devstack sudo[95306]: pam_unix(sudo:session): session closed for user root Jun 24 09:46:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d198b8e3-29fc-4f30-8a34-09d5d1427cf8 tempest-ServersNegativeTestJSON-866000907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.176s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:46:59 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-d198b8e3-29fc-4f30-8a34-09d5d1427cf8 tempest-ServersNegativeTestJSON-866000907 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:46:59 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-d198b8e3-29fc-4f30-8a34-09d5d1427cf8 tempest-ServersNegativeTestJSON-866000907 None] Deleted volume successfully. Jun 24 09:46:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d198b8e3-29fc-4f30-8a34-09d5d1427cf8 tempest-ServersNegativeTestJSON-866000907 None] Lock "cinder-ea273271-0317-43d3-bfdc-50cbe8a43b92-delete_volume" released by "delete_volume" :: held 3.983s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:46:59 devstack sudo[95309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9d76e9e2-2292-47e0-86c8-af8abf29ee45 Jun 24 09:46:59 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:47:00 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root Jun 24 09:47:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-28f8809a-811b-47f4-91c8-f3f4aa0a1b15 tempest-ServersNegativeTestJSON-866000907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9d76e9e2-2292-47e0-86c8-af8abf29ee45" returned: 0 in 1.281s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:47:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-28f8809a-811b-47f4-91c8-f3f4aa0a1b15 tempest-ServersNegativeTestJSON-866000907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9d76e9e2-2292-47e0-86c8-af8abf29ee45 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:47:00 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9d76e9e2-2292-47e0-86c8-af8abf29ee45 Jun 24 09:47:00 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:47:01 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Jun 24 09:47:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-28f8809a-811b-47f4-91c8-f3f4aa0a1b15 tempest-ServersNegativeTestJSON-866000907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9d76e9e2-2292-47e0-86c8-af8abf29ee45" returned: 0 in 0.979s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:47:01 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-28f8809a-811b-47f4-91c8-f3f4aa0a1b15 tempest-ServersNegativeTestJSON-866000907 None] Lock "cinder-quobyte-9d76e9e2-2292-47e0-86c8-af8abf29ee45" released by "delete_volume" :: held 2.347s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:47:01 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-28f8809a-811b-47f4-91c8-f3f4aa0a1b15 tempest-ServersNegativeTestJSON-866000907 None] Created reservations ['22cfeb8e-13a5-4f5e-aede-ae8a22351421', '0c95208c-8caa-4a40-9397-a823aa9ac8cd', 'b3933ff7-3201-4a57-90a4-c3201b74d3bb', '22196636-0e9e-489b-9f81-fc16cc9ff7d2'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:47:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-28f8809a-811b-47f4-91c8-f3f4aa0a1b15 tempest-ServersNegativeTestJSON-866000907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:47:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-28f8809a-811b-47f4-91c8-f3f4aa0a1b15 tempest-ServersNegativeTestJSON-866000907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:47:02 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-28f8809a-811b-47f4-91c8-f3f4aa0a1b15 tempest-ServersNegativeTestJSON-866000907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:47:02 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-28f8809a-811b-47f4-91c8-f3f4aa0a1b15 tempest-ServersNegativeTestJSON-866000907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:47:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-28f8809a-811b-47f4-91c8-f3f4aa0a1b15 tempest-ServersNegativeTestJSON-866000907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:47:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-28f8809a-811b-47f4-91c8-f3f4aa0a1b15 tempest-ServersNegativeTestJSON-866000907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:47:02 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:47:02 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:47:03 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Jun 24 09:47:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-28f8809a-811b-47f4-91c8-f3f4aa0a1b15 tempest-ServersNegativeTestJSON-866000907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.534s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:47:03 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-28f8809a-811b-47f4-91c8-f3f4aa0a1b15 tempest-ServersNegativeTestJSON-866000907 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:47:03 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-28f8809a-811b-47f4-91c8-f3f4aa0a1b15 tempest-ServersNegativeTestJSON-866000907 None] Deleted volume successfully. Jun 24 09:47:03 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-28f8809a-811b-47f4-91c8-f3f4aa0a1b15 tempest-ServersNegativeTestJSON-866000907 None] Lock "cinder-9d76e9e2-2292-47e0-86c8-af8abf29ee45-delete_volume" released by "delete_volume" :: held 4.341s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:47:04 devstack cinder-volume[93447]: WARNING py.warnings [req-5497cb51-e66f-44e0-ab2f-1a9261c9a1e5 req-16befa30-623c-4fe7-95c9-278ebe90f39b tempest-DeleteServersTestJSON-862633273 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jun 24 09:47:04 devstack cinder-volume[93447]: .first() Jun 24 09:47:04 devstack cinder-volume[93447]: Jun 24 09:47:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-5497cb51-e66f-44e0-ab2f-1a9261c9a1e5 req-16befa30-623c-4fe7-95c9-278ebe90f39b tempest-DeleteServersTestJSON-862633273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:47:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-5497cb51-e66f-44e0-ab2f-1a9261c9a1e5 req-16befa30-623c-4fe7-95c9-278ebe90f39b tempest-DeleteServersTestJSON-862633273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:47:04 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3866fc23-b05e-40e3-a006-7fda016a8483]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:47:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-5497cb51-e66f-44e0-ab2f-1a9261c9a1e5 req-16befa30-623c-4fe7-95c9-278ebe90f39b tempest-DeleteServersTestJSON-862633273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eff8c842-1bed-4115-a4c1-6da15c362f5b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:47:05 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eff8c842-1bed-4115-a4c1-6da15c362f5b Jun 24 09:47:05 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:47:06 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Jun 24 09:47:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-5497cb51-e66f-44e0-ab2f-1a9261c9a1e5 req-16befa30-623c-4fe7-95c9-278ebe90f39b tempest-DeleteServersTestJSON-862633273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eff8c842-1bed-4115-a4c1-6da15c362f5b" returned: 0 in 1.240s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:47:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-5497cb51-e66f-44e0-ab2f-1a9261c9a1e5 req-16befa30-623c-4fe7-95c9-278ebe90f39b tempest-DeleteServersTestJSON-862633273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.271s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:47:06 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-5497cb51-e66f-44e0-ab2f-1a9261c9a1e5 req-16befa30-623c-4fe7-95c9-278ebe90f39b tempest-DeleteServersTestJSON-862633273 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb', 'name': 'volume-eff8c842-1bed-4115-a4c1-6da15c362f5b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a22ad19-e57a-4c21-bf20-dba1b0aba5bd', 'enforce_multipath': True} {{(pid=93447) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 09:47:06 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-5497cb51-e66f-44e0-ab2f-1a9261c9a1e5 req-16befa30-623c-4fe7-95c9-278ebe90f39b tempest-DeleteServersTestJSON-862633273 None] attachment_update completed successfully. Jun 24 09:47:16 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:UPDATE=29,cinder:SELECT=27,cinder:INSERT=6,cinder:DELETE=1 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:47:16 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=17,cinder:UPDATE=25,cinder:DELETE=4,cinder:INSERT=5 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:47:16 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-e15309af-9902-4131-b7d1-f34728424ba6 req-d8d3ffd6-565e-48c9-90a9-047b07351623 tempest-DeleteServersTestJSON-862633273 None] Terminate volume connection completed successfully. Jun 24 09:47:16 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-e15309af-9902-4131-b7d1-f34728424ba6 req-d8d3ffd6-565e-48c9-90a9-047b07351623 tempest-DeleteServersTestJSON-862633273 None] Deleting attachment 6a22ad19-e57a-4c21-bf20-dba1b0aba5bd. {{(pid=93447) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 09:47:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-8f00f595-795d-49af-8df3-e23a9c47b020 req-b2ccb046-e0fd-4104-92bd-4fdec1338306 tempest-ServerActionsTestOtherA-2061493000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:47:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-8f00f595-795d-49af-8df3-e23a9c47b020 req-b2ccb046-e0fd-4104-92bd-4fdec1338306 tempest-ServerActionsTestOtherA-2061493000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:47:22 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c32eb6-177e-4bee-8958-2a4bba780dc2]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:47:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-8f00f595-795d-49af-8df3-e23a9c47b020 req-b2ccb046-e0fd-4104-92bd-4fdec1338306 tempest-ServerActionsTestOtherA-2061493000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-563aa654-5811-4740-a41d-6f65eb163b2e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:47:22 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-563aa654-5811-4740-a41d-6f65eb163b2e Jun 24 09:47:22 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:47:22 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fea13c89-3b7f-47aa-b89f-acf50c632e6e tempest-DeleteServersTestJSON-862633273 None] Acquiring lock "cinder-eff8c842-1bed-4115-a4c1-6da15c362f5b-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:47:22 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fea13c89-3b7f-47aa-b89f-acf50c632e6e tempest-DeleteServersTestJSON-862633273 None] Lock "cinder-eff8c842-1bed-4115-a4c1-6da15c362f5b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:47:22 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fea13c89-3b7f-47aa-b89f-acf50c632e6e tempest-DeleteServersTestJSON-862633273 None] Acquiring lock "cinder-quobyte-eff8c842-1bed-4115-a4c1-6da15c362f5b" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:47:22 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fea13c89-3b7f-47aa-b89f-acf50c632e6e tempest-DeleteServersTestJSON-862633273 None] Lock "cinder-quobyte-eff8c842-1bed-4115-a4c1-6da15c362f5b" acquired by "delete_volume" :: waited 0.026s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:47:23 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[976e5ade-2636-4136-84f3-6e8f7a54dba5]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:47:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fea13c89-3b7f-47aa-b89f-acf50c632e6e tempest-DeleteServersTestJSON-862633273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eff8c842-1bed-4115-a4c1-6da15c362f5b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:47:23 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eff8c842-1bed-4115-a4c1-6da15c362f5b Jun 24 09:47:23 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:47:23 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Jun 24 09:47:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-8f00f595-795d-49af-8df3-e23a9c47b020 req-b2ccb046-e0fd-4104-92bd-4fdec1338306 tempest-ServerActionsTestOtherA-2061493000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-563aa654-5811-4740-a41d-6f65eb163b2e" returned: 0 in 1.133s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:47:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-8f00f595-795d-49af-8df3-e23a9c47b020 req-b2ccb046-e0fd-4104-92bd-4fdec1338306 tempest-ServerActionsTestOtherA-2061493000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.161s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:47:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-8f00f595-795d-49af-8df3-e23a9c47b020 req-b2ccb046-e0fd-4104-92bd-4fdec1338306 tempest-ServerActionsTestOtherA-2061493000 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb', 'name': 'volume-563aa654-5811-4740-a41d-6f65eb163b2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84e2ca6a-e320-4195-bb25-ca8fb87f65c9', 'enforce_multipath': True} {{(pid=93447) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 09:47:23 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-8f00f595-795d-49af-8df3-e23a9c47b020 req-b2ccb046-e0fd-4104-92bd-4fdec1338306 tempest-ServerActionsTestOtherA-2061493000 None] attachment_update completed successfully. Jun 24 09:47:23 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Jun 24 09:47:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fea13c89-3b7f-47aa-b89f-acf50c632e6e tempest-DeleteServersTestJSON-862633273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eff8c842-1bed-4115-a4c1-6da15c362f5b" returned: 0 in 0.966s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:47:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fea13c89-3b7f-47aa-b89f-acf50c632e6e tempest-DeleteServersTestJSON-862633273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eff8c842-1bed-4115-a4c1-6da15c362f5b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:47:24 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eff8c842-1bed-4115-a4c1-6da15c362f5b Jun 24 09:47:24 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:47:24 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Jun 24 09:47:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fea13c89-3b7f-47aa-b89f-acf50c632e6e tempest-DeleteServersTestJSON-862633273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eff8c842-1bed-4115-a4c1-6da15c362f5b" returned: 0 in 0.822s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:47:24 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fea13c89-3b7f-47aa-b89f-acf50c632e6e tempest-DeleteServersTestJSON-862633273 None] Lock "cinder-quobyte-eff8c842-1bed-4115-a4c1-6da15c362f5b" released by "delete_volume" :: held 1.845s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:47:24 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-fea13c89-3b7f-47aa-b89f-acf50c632e6e tempest-DeleteServersTestJSON-862633273 None] Created reservations ['5e46ce56-fd90-4919-81ef-b92d75a1df09', 'bc6ec342-7a02-493d-912f-e7408a254f2b', '14dd874d-6eef-4183-9ded-e3b8d8a0382a', 'f68854bc-2e87-4524-a3a7-0754b5c535ce'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:47:24 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:47:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:47:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:47:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:47:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:47:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:47:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:47:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-fea13c89-3b7f-47aa-b89f-acf50c632e6e tempest-DeleteServersTestJSON-862633273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:47:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-fea13c89-3b7f-47aa-b89f-acf50c632e6e tempest-DeleteServersTestJSON-862633273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:47:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-fea13c89-3b7f-47aa-b89f-acf50c632e6e tempest-DeleteServersTestJSON-862633273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:47:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-fea13c89-3b7f-47aa-b89f-acf50c632e6e tempest-DeleteServersTestJSON-862633273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:47:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-fea13c89-3b7f-47aa-b89f-acf50c632e6e tempest-DeleteServersTestJSON-862633273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:47:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fea13c89-3b7f-47aa-b89f-acf50c632e6e tempest-DeleteServersTestJSON-862633273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:47:25 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:47:25 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:47:25 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:47:25 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:47:25 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Jun 24 09:47:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.835s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:47:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:47:25 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Jun 24 09:47:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fea13c89-3b7f-47aa-b89f-acf50c632e6e tempest-DeleteServersTestJSON-862633273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.972s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:47:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-fea13c89-3b7f-47aa-b89f-acf50c632e6e tempest-DeleteServersTestJSON-862633273 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:47:26 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-fea13c89-3b7f-47aa-b89f-acf50c632e6e tempest-DeleteServersTestJSON-862633273 None] Deleted volume successfully. Jun 24 09:47:26 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fea13c89-3b7f-47aa-b89f-acf50c632e6e tempest-DeleteServersTestJSON-862633273 None] Lock "cinder-eff8c842-1bed-4115-a4c1-6da15c362f5b-delete_volume" released by "delete_volume" :: held 3.143s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:47:34 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=13,cinder:UPDATE=9,cinder:INSERT=1 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:47:36 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=10,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:47:36 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-e2217064-25cc-4be3-a231-794b349dd834 req-6a2db232-683e-401f-b33f-dc52536bf627 tempest-ServerActionsTestOtherA-2061493000 None] Terminate volume connection completed successfully. Jun 24 09:47:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-e2217064-25cc-4be3-a231-794b349dd834 req-6a2db232-683e-401f-b33f-dc52536bf627 tempest-ServerActionsTestOtherA-2061493000 None] Deleting attachment 84e2ca6a-e320-4195-bb25-ca8fb87f65c9. {{(pid=93447) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 09:47:36 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:47:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Flow 'volume_create_manager' (b2e7871e-9bb7-4ec6-9ae3-4dd4879cb5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:47:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5df2a759-2bc8-4fcc-9072-395dc8d1e123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:47:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5df2a759-2bc8-4fcc-9072-395dc8d1e123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1195497392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc954b5-3a4f-44c1-9d3e-6abc842cf27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903a26ab81cc4a5eb0b6f1c122713255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:47:37Z,use_quota=True,user_id='1e1fa3454f2845b79251548e6308c9a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:47:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1be08c6-daf2-4157-84a7-3cbc96c93c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:47:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1be08c6-daf2-4157-84a7-3cbc96c93c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:47:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3a97e95-4133-4d69-9759-22b483f6f680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:47:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3a97e95-4133-4d69-9759-22b483f6f680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bc954b5-3a4f-44c1-9d3e-6abc842cf27e', 'volume_name': 'volume-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:47:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703e24fd-6bce-4f35-b831-9cbafe451a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:47:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (703e24fd-6bce-4f35-b831-9cbafe451a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:47:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd4f2c1f-8ef6-4ece-860a-ba517ab83d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:47:36 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Volume 5bc954b5-3a4f-44c1-9d3e-6abc842cf27e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e', 'volume_size': 1} Jun 24 09:47:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:47:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:47:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1195497392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc954b5-3a4f-44c1-9d3e-6abc842cf27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='903a26ab81cc4a5eb0b6f1c122713255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:47:37Z,use_quota=True,user_id='1e1fa3454f2845b79251548e6308c9a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:47:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Creating volume 5bc954b5-3a4f-44c1-9d3e-6abc842cf27e {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:47:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:47:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:47:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:47:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:47:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:47:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:47:36 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:47:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:47:36 devstack sudo[96433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e 1073741824 Jun 24 09:47:36 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:47:38 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root Jun 24 09:47:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e 1073741824" returned: 0 in 1.337s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:47:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:47:38 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e Jun 24 09:47:38 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:47:39 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Jun 24 09:47:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-e2217064-25cc-4be3-a231-794b349dd834 req-b9b3bdc5-5c86-48e7-aeb4-c70bf7976757 tempest-ServerActionsTestOtherA-2061493000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:47:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e" returned: 0 in 0.797s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:47:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] <== create_volume: return (2223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:47:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.226s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:47:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-e2217064-25cc-4be3-a231-794b349dd834 req-b9b3bdc5-5c86-48e7-aeb4-c70bf7976757 tempest-ServerActionsTestOtherA-2061493000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.012s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:47:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd4f2c1f-8ef6-4ece-860a-ba517ab83d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:47:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (122b52b1-8292-451c-9de6-728dad29ba29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:47:39 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb577dc-ff9a-4c6b-a2eb-74adcb9fba0e]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:47:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-e2217064-25cc-4be3-a231-794b349dd834 req-b9b3bdc5-5c86-48e7-aeb4-c70bf7976757 tempest-ServerActionsTestOtherA-2061493000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-563aa654-5811-4740-a41d-6f65eb163b2e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:47:39 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Volume volume-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e (5bc954b5-3a4f-44c1-9d3e-6abc842cf27e): created successfully Jun 24 09:47:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (122b52b1-8292-451c-9de6-728dad29ba29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:47:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Flow 'volume_create_manager' (b2e7871e-9bb7-4ec6-9ae3-4dd4879cb5e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:47:39 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-b2baa73d-6091-4c69-bc8e-4cbc4aee3030 tempest-TaggedAttachmentsTest-1049386845 None] Created volume successfully. Jun 24 09:47:39 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-563aa654-5811-4740-a41d-6f65eb163b2e Jun 24 09:47:39 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:47:39 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Jun 24 09:47:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-e2217064-25cc-4be3-a231-794b349dd834 req-b9b3bdc5-5c86-48e7-aeb4-c70bf7976757 tempest-ServerActionsTestOtherA-2061493000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-563aa654-5811-4740-a41d-6f65eb163b2e" returned: 0 in 0.837s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:47:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-e2217064-25cc-4be3-a231-794b349dd834 req-b9b3bdc5-5c86-48e7-aeb4-c70bf7976757 tempest-ServerActionsTestOtherA-2061493000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.877s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:47:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-e2217064-25cc-4be3-a231-794b349dd834 req-b9b3bdc5-5c86-48e7-aeb4-c70bf7976757 tempest-ServerActionsTestOtherA-2061493000 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb', 'name': 'volume-563aa654-5811-4740-a41d-6f65eb163b2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d7fd36b-e3a6-4bcb-843c-e14902143ff2', 'enforce_multipath': True} {{(pid=93447) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 09:47:40 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-e2217064-25cc-4be3-a231-794b349dd834 req-b9b3bdc5-5c86-48e7-aeb4-c70bf7976757 tempest-ServerActionsTestOtherA-2061493000 None] attachment_update completed successfully. Jun 24 09:47:50 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:47:50 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:48:18 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-a3e689c9-200c-4eca-8ee6-808f49a003cb req-4983c587-ffdd-4fe1-beef-05e539d15882 tempest-ServerActionsTestOtherA-2061493000 None] Terminate volume connection completed successfully. Jun 24 09:48:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-a3e689c9-200c-4eca-8ee6-808f49a003cb req-4983c587-ffdd-4fe1-beef-05e539d15882 tempest-ServerActionsTestOtherA-2061493000 None] Deleting attachment 6d7fd36b-e3a6-4bcb-843c-e14902143ff2. {{(pid=93447) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 09:48:24 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:48:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:48:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:48:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:48:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:48:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:48:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:48:25 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:48:25 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:48:25 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Jun 24 09:48:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.680s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:48:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:48:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:48:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 8 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 09:48:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 09:48:26 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:48:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Flow 'volume_create_manager' (bf6a1f21-b268-4b49-b4c2-fd059c3e4e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:48:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (effc95ed-3831-42c3-ba1f-7c66741a48fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:48:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (effc95ed-3831-42c3-ba1f-7c66741a48fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1671237928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb945e4-7fc2-4965-8b00-a4d7dce202ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8574cb4538ed4694bb436a999b118f4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:48:26Z,use_quota=True,user_id='15f41a1d662343f097ed20cdbc4116f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:48:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688d2809-a2a0-4fef-8306-4a415f4173c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:48:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688d2809-a2a0-4fef-8306-4a415f4173c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:48:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5965f360-d2aa-4014-a324-82a9c7bb7a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:48:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5965f360-d2aa-4014-a324-82a9c7bb7a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deb945e4-7fc2-4965-8b00-a4d7dce202ce', 'volume_name': 'volume-deb945e4-7fc2-4965-8b00-a4d7dce202ce', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:48:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabb3356-e4eb-44f0-bcc1-d9a37d8ce1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:48:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabb3356-e4eb-44f0-bcc1-d9a37d8ce1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:48:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1fa38ce-9bb5-4f3b-8292-e990ad9925c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:48:26 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Volume deb945e4-7fc2-4965-8b00-a4d7dce202ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deb945e4-7fc2-4965-8b00-a4d7dce202ce', 'volume_size': 1} Jun 24 09:48:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:48:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:48:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1671237928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deb945e4-7fc2-4965-8b00-a4d7dce202ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8574cb4538ed4694bb436a999b118f4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:48:26Z,use_quota=True,user_id='15f41a1d662343f097ed20cdbc4116f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:48:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Creating volume deb945e4-7fc2-4965-8b00-a4d7dce202ce {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:48:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:48:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:48:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:48:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:48:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:48:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:48:26 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:48:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-deb945e4-7fc2-4965-8b00-a4d7dce202ce 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:48:26 devstack sudo[97521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-deb945e4-7fc2-4965-8b00-a4d7dce202ce 1073741824 Jun 24 09:48:26 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:48:27 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root Jun 24 09:48:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-deb945e4-7fc2-4965-8b00-a4d7dce202ce 1073741824" returned: 0 in 0.907s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:48:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-deb945e4-7fc2-4965-8b00-a4d7dce202ce {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:48:27 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-deb945e4-7fc2-4965-8b00-a4d7dce202ce Jun 24 09:48:27 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:48:28 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Jun 24 09:48:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-deb945e4-7fc2-4965-8b00-a4d7dce202ce" returned: 0 in 0.806s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:48:28 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:48:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:48:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1fa38ce-9bb5-4f3b-8292-e990ad9925c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deb945e4-7fc2-4965-8b00-a4d7dce202ce', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:48:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5817f20-77b4-49e3-aa46-1cc4b6b7a2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:48:28 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Volume volume-deb945e4-7fc2-4965-8b00-a4d7dce202ce (deb945e4-7fc2-4965-8b00-a4d7dce202ce): created successfully Jun 24 09:48:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5817f20-77b4-49e3-aa46-1cc4b6b7a2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:48:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Flow 'volume_create_manager' (bf6a1f21-b268-4b49-b4c2-fd059c3e4e39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:48:28 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-25b0fc0f-14c1-4974-bf28-30d1fc3e22dc tempest-AttachVolumeNegativeTest-2082640456 None] Created volume successfully. Jun 24 09:48:28 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5a38fa21-6f42-476b-a54f-42d1fe251acd tempest-ServerActionsTestOtherA-2061493000 None] Acquiring lock "cinder-563aa654-5811-4740-a41d-6f65eb163b2e-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:48:28 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5a38fa21-6f42-476b-a54f-42d1fe251acd tempest-ServerActionsTestOtherA-2061493000 None] Lock "cinder-563aa654-5811-4740-a41d-6f65eb163b2e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:48:28 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5a38fa21-6f42-476b-a54f-42d1fe251acd tempest-ServerActionsTestOtherA-2061493000 None] Acquiring lock "cinder-quobyte-563aa654-5811-4740-a41d-6f65eb163b2e" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:48:28 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5a38fa21-6f42-476b-a54f-42d1fe251acd tempest-ServerActionsTestOtherA-2061493000 None] Lock "cinder-quobyte-563aa654-5811-4740-a41d-6f65eb163b2e" acquired by "delete_volume" :: waited 0.015s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:48:28 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[38705bab-f158-4e5e-a87a-43b095f6dfab]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:48:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5a38fa21-6f42-476b-a54f-42d1fe251acd tempest-ServerActionsTestOtherA-2061493000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-563aa654-5811-4740-a41d-6f65eb163b2e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:48:29 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-563aa654-5811-4740-a41d-6f65eb163b2e Jun 24 09:48:29 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:48:29 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Jun 24 09:48:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5a38fa21-6f42-476b-a54f-42d1fe251acd tempest-ServerActionsTestOtherA-2061493000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-563aa654-5811-4740-a41d-6f65eb163b2e" returned: 0 in 0.776s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:48:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5a38fa21-6f42-476b-a54f-42d1fe251acd tempest-ServerActionsTestOtherA-2061493000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-563aa654-5811-4740-a41d-6f65eb163b2e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:48:29 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-563aa654-5811-4740-a41d-6f65eb163b2e Jun 24 09:48:29 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:48:30 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Jun 24 09:48:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5a38fa21-6f42-476b-a54f-42d1fe251acd tempest-ServerActionsTestOtherA-2061493000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-563aa654-5811-4740-a41d-6f65eb163b2e" returned: 0 in 0.645s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:48:30 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5a38fa21-6f42-476b-a54f-42d1fe251acd tempest-ServerActionsTestOtherA-2061493000 None] Lock "cinder-quobyte-563aa654-5811-4740-a41d-6f65eb163b2e" released by "delete_volume" :: held 1.459s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:48:30 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-5a38fa21-6f42-476b-a54f-42d1fe251acd tempest-ServerActionsTestOtherA-2061493000 None] Created reservations ['aa7d806a-ab0b-410e-88a5-1bd9513a9416', 'c1fae8dc-3145-4a2f-a4dd-7a31fc61beac', 'a2ba085e-ff46-485e-8ffb-7bc503647d64', 'ff392211-ca96-4346-b358-01adb17e94dd'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:48:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5a38fa21-6f42-476b-a54f-42d1fe251acd tempest-ServerActionsTestOtherA-2061493000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:48:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5a38fa21-6f42-476b-a54f-42d1fe251acd tempest-ServerActionsTestOtherA-2061493000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:48:30 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-5a38fa21-6f42-476b-a54f-42d1fe251acd tempest-ServerActionsTestOtherA-2061493000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:48:30 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-5a38fa21-6f42-476b-a54f-42d1fe251acd tempest-ServerActionsTestOtherA-2061493000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:48:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5a38fa21-6f42-476b-a54f-42d1fe251acd tempest-ServerActionsTestOtherA-2061493000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:48:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5a38fa21-6f42-476b-a54f-42d1fe251acd tempest-ServerActionsTestOtherA-2061493000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:48:30 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:48:30 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:48:31 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Jun 24 09:48:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5a38fa21-6f42-476b-a54f-42d1fe251acd tempest-ServerActionsTestOtherA-2061493000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.701s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:48:31 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-5a38fa21-6f42-476b-a54f-42d1fe251acd tempest-ServerActionsTestOtherA-2061493000 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:48:31 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-5a38fa21-6f42-476b-a54f-42d1fe251acd tempest-ServerActionsTestOtherA-2061493000 None] Deleted volume successfully. Jun 24 09:48:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5a38fa21-6f42-476b-a54f-42d1fe251acd tempest-ServerActionsTestOtherA-2061493000 None] Lock "cinder-563aa654-5811-4740-a41d-6f65eb163b2e-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:48:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-d7f5833a-e6eb-4223-9b0a-375671ee8086 req-e22cb19d-d065-4b64-8215-6d41203e10af tempest-AttachVolumeNegativeTest-2082640456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:48:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-d7f5833a-e6eb-4223-9b0a-375671ee8086 req-e22cb19d-d065-4b64-8215-6d41203e10af tempest-AttachVolumeNegativeTest-2082640456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:48:31 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ddd12b-2da2-406a-b116-8c76219eb844]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:48:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-d7f5833a-e6eb-4223-9b0a-375671ee8086 req-e22cb19d-d065-4b64-8215-6d41203e10af tempest-AttachVolumeNegativeTest-2082640456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-deb945e4-7fc2-4965-8b00-a4d7dce202ce {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:48:31 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-deb945e4-7fc2-4965-8b00-a4d7dce202ce Jun 24 09:48:31 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:48:32 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Jun 24 09:48:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-d7f5833a-e6eb-4223-9b0a-375671ee8086 req-e22cb19d-d065-4b64-8215-6d41203e10af tempest-AttachVolumeNegativeTest-2082640456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-deb945e4-7fc2-4965-8b00-a4d7dce202ce" returned: 0 in 0.966s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:48:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-d7f5833a-e6eb-4223-9b0a-375671ee8086 req-e22cb19d-d065-4b64-8215-6d41203e10af tempest-AttachVolumeNegativeTest-2082640456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.989s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:48:32 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-d7f5833a-e6eb-4223-9b0a-375671ee8086 req-e22cb19d-d065-4b64-8215-6d41203e10af tempest-AttachVolumeNegativeTest-2082640456 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb', 'name': 'volume-deb945e4-7fc2-4965-8b00-a4d7dce202ce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7fe5027-9b03-450c-b2e3-2858dccd6585', 'enforce_multipath': True} {{(pid=93447) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 09:48:32 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-d7f5833a-e6eb-4223-9b0a-375671ee8086 req-e22cb19d-d065-4b64-8215-6d41203e10af tempest-AttachVolumeNegativeTest-2082640456 None] attachment_update completed successfully. Jun 24 09:48:40 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:48:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Flow 'volume_create_manager' (4498eba9-0a7d-4bac-a753-4e39a628010f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:48:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66323046-2d59-4e98-84c2-c23bdd81f280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:48:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66323046-2d59-4e98-84c2-c23bdd81f280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1094105843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4bfd5e7-454f-4bce-b222-e8412b950806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fbf08351334e25808b4ec311c328a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:48:40Z,use_quota=True,user_id='901dbdfb528c44deb9fe1082516c1088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:48:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0002426-5ad8-47f4-9ee6-5b91794855f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:48:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0002426-5ad8-47f4-9ee6-5b91794855f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:48:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5510e4-6bd0-4d77-92d9-642ad7f876b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:48:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5510e4-6bd0-4d77-92d9-642ad7f876b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4bfd5e7-454f-4bce-b222-e8412b950806', 'volume_name': 'volume-e4bfd5e7-454f-4bce-b222-e8412b950806', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:48:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd4464f-cfff-44e3-97ae-2c144c96d51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:48:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd4464f-cfff-44e3-97ae-2c144c96d51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:48:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5a662f6-9025-45a9-9ce1-bb03fa939ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:48:40 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Volume e4bfd5e7-454f-4bce-b222-e8412b950806: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4bfd5e7-454f-4bce-b222-e8412b950806', 'volume_size': 1} Jun 24 09:48:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:48:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:48:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1094105843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4bfd5e7-454f-4bce-b222-e8412b950806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6fbf08351334e25808b4ec311c328a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:48:40Z,use_quota=True,user_id='901dbdfb528c44deb9fe1082516c1088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:48:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Creating volume e4bfd5e7-454f-4bce-b222-e8412b950806 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:48:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:48:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:48:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:48:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:48:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:48:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:48:40 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:48:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e4bfd5e7-454f-4bce-b222-e8412b950806 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:48:40 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e4bfd5e7-454f-4bce-b222-e8412b950806 1073741824 Jun 24 09:48:40 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:48:41 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Jun 24 09:48:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e4bfd5e7-454f-4bce-b222-e8412b950806 1073741824" returned: 0 in 0.973s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:48:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e4bfd5e7-454f-4bce-b222-e8412b950806 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:48:41 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e4bfd5e7-454f-4bce-b222-e8412b950806 Jun 24 09:48:41 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:48:41 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Jun 24 09:48:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e4bfd5e7-454f-4bce-b222-e8412b950806" returned: 0 in 0.685s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:48:41 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:48:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:48:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5a662f6-9025-45a9-9ce1-bb03fa939ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4bfd5e7-454f-4bce-b222-e8412b950806', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:48:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40ad93a-1d33-4ec4-99e8-ef2a6491fe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:48:41 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Volume volume-e4bfd5e7-454f-4bce-b222-e8412b950806 (e4bfd5e7-454f-4bce-b222-e8412b950806): created successfully Jun 24 09:48:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40ad93a-1d33-4ec4-99e8-ef2a6491fe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:48:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Flow 'volume_create_manager' (4498eba9-0a7d-4bac-a753-4e39a628010f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:48:41 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-adec348c-8764-475e-a91e-b4f0a5bb28c0 tempest-AttachVolumeShelveTestJSON-1811866213 None] Created volume successfully. Jun 24 09:48:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-dfc56ee5-8447-4442-966f-21642022376d req-457485ad-b4b7-4dda-8f06-66f3710b2619 tempest-TaggedAttachmentsTest-1049386845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:48:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-dfc56ee5-8447-4442-966f-21642022376d req-457485ad-b4b7-4dda-8f06-66f3710b2619 tempest-TaggedAttachmentsTest-1049386845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:48:42 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4b09b8-3ffa-4ca0-8c59-270cb453406c]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:48:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-dfc56ee5-8447-4442-966f-21642022376d req-457485ad-b4b7-4dda-8f06-66f3710b2619 tempest-TaggedAttachmentsTest-1049386845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:48:43 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e Jun 24 09:48:43 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:48:43 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Jun 24 09:48:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-dfc56ee5-8447-4442-966f-21642022376d req-457485ad-b4b7-4dda-8f06-66f3710b2619 tempest-TaggedAttachmentsTest-1049386845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e" returned: 0 in 0.907s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:48:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-dfc56ee5-8447-4442-966f-21642022376d req-457485ad-b4b7-4dda-8f06-66f3710b2619 tempest-TaggedAttachmentsTest-1049386845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.932s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:48:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-dfc56ee5-8447-4442-966f-21642022376d req-457485ad-b4b7-4dda-8f06-66f3710b2619 tempest-TaggedAttachmentsTest-1049386845 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb', 'name': 'volume-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff7db2b4-a441-4ab8-96d5-4753eaf1e6d9', 'enforce_multipath': True} {{(pid=93447) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 09:48:43 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-dfc56ee5-8447-4442-966f-21642022376d req-457485ad-b4b7-4dda-8f06-66f3710b2619 tempest-TaggedAttachmentsTest-1049386845 None] attachment_update completed successfully. Jun 24 09:48:52 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-75ed793e-e2af-455f-a90f-217f1856ebcf req-93e3770b-866a-44e8-9dcc-74b2d30c92c7 tempest-TaggedAttachmentsTest-1049386845 None] Terminate volume connection completed successfully. Jun 24 09:48:52 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-75ed793e-e2af-455f-a90f-217f1856ebcf req-93e3770b-866a-44e8-9dcc-74b2d30c92c7 tempest-TaggedAttachmentsTest-1049386845 None] Deleting attachment ff7db2b4-a441-4ab8-96d5-4753eaf1e6d9. {{(pid=93447) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 09:48:53 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=21,cinder:UPDATE=19,cinder:DELETE=1,cinder:INSERT=2 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:49:02 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=24,cinder:INSERT=4,cinder:UPDATE=16,cinder:DELETE=2 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:49:03 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-522d6a1d-be4a-4715-a220-e0e4a948301c req-bb2a76e7-dad9-4362-97fd-8af172fe1926 tempest-AttachVolumeShelveTestJSON-1811866213 None] No connector for attachment ce5fafa3-3080-4e6a-8d13-3c38433b5063; skipping storage backend terminate_connection call. {{(pid=93447) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 24 09:49:03 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-522d6a1d-be4a-4715-a220-e0e4a948301c req-bb2a76e7-dad9-4362-97fd-8af172fe1926 tempest-AttachVolumeShelveTestJSON-1811866213 None] Deleting attachment ce5fafa3-3080-4e6a-8d13-3c38433b5063. {{(pid=93447) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 09:49:13 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=1 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:49:13 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=1 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:49:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-36e4e991-9ae5-4e58-ad85-1dd52ab21716 tempest-TaggedAttachmentsTest-1049386845 None] Acquiring lock "cinder-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:49:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-36e4e991-9ae5-4e58-ad85-1dd52ab21716 tempest-TaggedAttachmentsTest-1049386845 None] Lock "cinder-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:49:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-36e4e991-9ae5-4e58-ad85-1dd52ab21716 tempest-TaggedAttachmentsTest-1049386845 None] Acquiring lock "cinder-quobyte-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:49:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-36e4e991-9ae5-4e58-ad85-1dd52ab21716 tempest-TaggedAttachmentsTest-1049386845 None] Lock "cinder-quobyte-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e" acquired by "delete_volume" :: waited 0.035s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:49:23 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd72fea6-ce04-473c-b9af-c961996ffcbe]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:49:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-36e4e991-9ae5-4e58-ad85-1dd52ab21716 tempest-TaggedAttachmentsTest-1049386845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:49:23 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e Jun 24 09:49:23 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:49:24 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:49:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:49:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:49:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:49:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:49:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:49:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:49:25 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:49:25 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:49:25 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Jun 24 09:49:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-36e4e991-9ae5-4e58-ad85-1dd52ab21716 tempest-TaggedAttachmentsTest-1049386845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e" returned: 0 in 1.935s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:49:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-36e4e991-9ae5-4e58-ad85-1dd52ab21716 tempest-TaggedAttachmentsTest-1049386845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:49:25 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e Jun 24 09:49:25 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:49:26 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Jun 24 09:49:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.866s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:49:26 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:49:26 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:49:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 8 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 09:49:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 09:49:27 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Jun 24 09:49:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-36e4e991-9ae5-4e58-ad85-1dd52ab21716 tempest-TaggedAttachmentsTest-1049386845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e" returned: 0 in 1.842s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:49:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-36e4e991-9ae5-4e58-ad85-1dd52ab21716 tempest-TaggedAttachmentsTest-1049386845 None] Lock "cinder-quobyte-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e" released by "delete_volume" :: held 3.936s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:49:27 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-36e4e991-9ae5-4e58-ad85-1dd52ab21716 tempest-TaggedAttachmentsTest-1049386845 None] Created reservations ['17bf6f20-49a7-4588-adb8-4805fd2a5b3c', '8e13062c-0227-40c9-9fe2-0b015846baa8', 'cb0b4ffe-e372-4cba-a101-049d5b314dde', '0f690652-2698-43e6-9aa2-46d503e52b04'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:49:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-36e4e991-9ae5-4e58-ad85-1dd52ab21716 tempest-TaggedAttachmentsTest-1049386845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:49:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-36e4e991-9ae5-4e58-ad85-1dd52ab21716 tempest-TaggedAttachmentsTest-1049386845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:49:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-36e4e991-9ae5-4e58-ad85-1dd52ab21716 tempest-TaggedAttachmentsTest-1049386845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:49:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-36e4e991-9ae5-4e58-ad85-1dd52ab21716 tempest-TaggedAttachmentsTest-1049386845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:49:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-36e4e991-9ae5-4e58-ad85-1dd52ab21716 tempest-TaggedAttachmentsTest-1049386845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:49:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-36e4e991-9ae5-4e58-ad85-1dd52ab21716 tempest-TaggedAttachmentsTest-1049386845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:49:27 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:49:27 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:49:29 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Jun 24 09:49:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-36e4e991-9ae5-4e58-ad85-1dd52ab21716 tempest-TaggedAttachmentsTest-1049386845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.384s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:49:29 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-36e4e991-9ae5-4e58-ad85-1dd52ab21716 tempest-TaggedAttachmentsTest-1049386845 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:49:29 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-36e4e991-9ae5-4e58-ad85-1dd52ab21716 tempest-TaggedAttachmentsTest-1049386845 None] Deleted volume successfully. Jun 24 09:49:29 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-36e4e991-9ae5-4e58-ad85-1dd52ab21716 tempest-TaggedAttachmentsTest-1049386845 None] Lock "cinder-5bc954b5-3a4f-44c1-9d3e-6abc842cf27e-delete_volume" released by "delete_volume" :: held 5.941s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:49:37 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-dee4363f-475f-4439-9900-63f072ed04b8 req-3675d13e-04d2-4112-b2fd-8ce9374c2090 tempest-AttachVolumeNegativeTest-2082640456 None] Terminate volume connection completed successfully. Jun 24 09:49:37 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-dee4363f-475f-4439-9900-63f072ed04b8 req-3675d13e-04d2-4112-b2fd-8ce9374c2090 tempest-AttachVolumeNegativeTest-2082640456 None] Deleting attachment f7fe5027-9b03-450c-b2e3-2858dccd6585. {{(pid=93447) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 09:49:39 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:49:43 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:49:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Flow 'volume_create_manager' (bb750c01-bff2-4dc5-bf9b-310ee63a06e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:49:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9924fea6-d207-4c1b-9e25-a7e8281ccf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:49:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9924fea6-d207-4c1b-9e25-a7e8281ccf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1326069272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8179705-854a-4ea6-9b76-8310c9fce282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0895440e2e6b47b68d14ad2dd434be58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:49:43Z,use_quota=True,user_id='3bc3452b7a1f45aeb947ab35eba43187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:49:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527af1f1-fef8-4996-8df8-c95722542192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:49:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527af1f1-fef8-4996-8df8-c95722542192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:49:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7612216d-2c3e-4509-a94a-13844d4d6b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:49:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7612216d-2c3e-4509-a94a-13844d4d6b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8179705-854a-4ea6-9b76-8310c9fce282', 'volume_name': 'volume-e8179705-854a-4ea6-9b76-8310c9fce282', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:49:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21e79dd-ef88-4d7a-9b47-4ee7fed4370e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:49:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21e79dd-ef88-4d7a-9b47-4ee7fed4370e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:49:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c7f21c-313b-44ec-96bb-f61d9e61ae7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:49:43 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Volume e8179705-854a-4ea6-9b76-8310c9fce282: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8179705-854a-4ea6-9b76-8310c9fce282', 'volume_size': 1} Jun 24 09:49:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:49:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:49:43 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1326069272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8179705-854a-4ea6-9b76-8310c9fce282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0895440e2e6b47b68d14ad2dd434be58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:49:43Z,use_quota=True,user_id='3bc3452b7a1f45aeb947ab35eba43187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:49:43 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Creating volume e8179705-854a-4ea6-9b76-8310c9fce282 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:49:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:49:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:49:43 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:49:43 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:49:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:49:43 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:49:43 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:49:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e8179705-854a-4ea6-9b76-8310c9fce282 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:49:43 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e8179705-854a-4ea6-9b76-8310c9fce282 1073741824 Jun 24 09:49:43 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:49:45 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Jun 24 09:49:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e8179705-854a-4ea6-9b76-8310c9fce282 1073741824" returned: 0 in 1.930s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:49:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e8179705-854a-4ea6-9b76-8310c9fce282 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:49:45 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e8179705-854a-4ea6-9b76-8310c9fce282 Jun 24 09:49:45 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:49:46 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Jun 24 09:49:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e8179705-854a-4ea6-9b76-8310c9fce282" returned: 0 in 1.195s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:49:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] <== create_volume: return (3199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:49:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.201s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:49:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c7f21c-313b-44ec-96bb-f61d9e61ae7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8179705-854a-4ea6-9b76-8310c9fce282', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:49:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce81612-b395-440e-b944-a36fa4308304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:49:46 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Volume volume-e8179705-854a-4ea6-9b76-8310c9fce282 (e8179705-854a-4ea6-9b76-8310c9fce282): created successfully Jun 24 09:49:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce81612-b395-440e-b944-a36fa4308304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:49:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Flow 'volume_create_manager' (bb750c01-bff2-4dc5-bf9b-310ee63a06e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:49:46 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-4e0bc09f-a92c-42ac-be87-53faa3c8ff6c tempest-ServerRescueNegativeTestJSON-473158836 None] Created volume successfully. Jun 24 09:49:50 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:49:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Flow 'volume_create_manager' (aaa0cfd1-84ed-42d9-a3ba-0462eb75c7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:49:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08abdd03-f682-4442-a571-3ea821ab2968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:49:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08abdd03-f682-4442-a571-3ea821ab2968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-617031698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b006eb5-e767-4fa4-ad17-a65a7c43b206,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5505cae9e92f4c3984ab5a4690d98ce3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:49:51Z,use_quota=True,user_id='7e694af5a61b4d97bc0ec0c9122bc5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:49:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d4f990-bb9d-4c0b-8836-d101f89f42ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:49:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d4f990-bb9d-4c0b-8836-d101f89f42ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:49:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f002d1-8d7c-400e-92b2-579ecfb7cb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:49:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f002d1-8d7c-400e-92b2-579ecfb7cb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b006eb5-e767-4fa4-ad17-a65a7c43b206', 'volume_name': 'volume-6b006eb5-e767-4fa4-ad17-a65a7c43b206', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:49:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf14de25-643e-4c1a-a85b-3bf7083e1d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:49:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf14de25-643e-4c1a-a85b-3bf7083e1d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:49:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f84f9e5-ee47-4873-95ae-1160a629b432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:49:50 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Volume 6b006eb5-e767-4fa4-ad17-a65a7c43b206: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b006eb5-e767-4fa4-ad17-a65a7c43b206', 'volume_size': 1} Jun 24 09:49:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:49:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:49:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-617031698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b006eb5-e767-4fa4-ad17-a65a7c43b206,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5505cae9e92f4c3984ab5a4690d98ce3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:49:51Z,use_quota=True,user_id='7e694af5a61b4d97bc0ec0c9122bc5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:49:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Creating volume 6b006eb5-e767-4fa4-ad17-a65a7c43b206 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:49:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:49:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:49:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:49:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:49:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:49:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:49:50 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:49:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6b006eb5-e767-4fa4-ad17-a65a7c43b206 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:49:50 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6b006eb5-e767-4fa4-ad17-a65a7c43b206 1073741824 Jun 24 09:49:50 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:49:52 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Jun 24 09:49:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6b006eb5-e767-4fa4-ad17-a65a7c43b206 1073741824" returned: 0 in 1.087s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:49:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6b006eb5-e767-4fa4-ad17-a65a7c43b206 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:49:52 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6b006eb5-e767-4fa4-ad17-a65a7c43b206 Jun 24 09:49:52 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:49:53 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Jun 24 09:49:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6b006eb5-e767-4fa4-ad17-a65a7c43b206" returned: 0 in 1.217s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:49:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] <== create_volume: return (2383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:49:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.386s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:49:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f84f9e5-ee47-4873-95ae-1160a629b432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b006eb5-e767-4fa4-ad17-a65a7c43b206', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:49:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad0ee72-355b-499d-992c-4a7652ba4cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:49:53 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Volume volume-6b006eb5-e767-4fa4-ad17-a65a7c43b206 (6b006eb5-e767-4fa4-ad17-a65a7c43b206): created successfully Jun 24 09:49:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad0ee72-355b-499d-992c-4a7652ba4cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:49:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Flow 'volume_create_manager' (aaa0cfd1-84ed-42d9-a3ba-0462eb75c7d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:49:53 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-a4af7cf2-d6cb-4788-99d7-cd2af5132e91 tempest-VolumesTestJSON-1326848861 None] Created volume successfully. Jun 24 09:49:54 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:49:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Flow 'volume_create_manager' (28e6c0c1-fbc5-45b5-a6ff-2cf6e1589a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:49:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d9e6662-174a-40d4-91d0-07b252040841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:49:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d9e6662-174a-40d4-91d0-07b252040841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1142131315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5767caa7-8cb0-4aac-9694-85151fbacab1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5505cae9e92f4c3984ab5a4690d98ce3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:49:55Z,use_quota=True,user_id='7e694af5a61b4d97bc0ec0c9122bc5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:49:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e00d45-7c7e-4a49-a76b-c0b886e28b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:49:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e00d45-7c7e-4a49-a76b-c0b886e28b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:49:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30975f2e-4d45-403c-a43c-1e3b0e055325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:49:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30975f2e-4d45-403c-a43c-1e3b0e055325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5767caa7-8cb0-4aac-9694-85151fbacab1', 'volume_name': 'volume-5767caa7-8cb0-4aac-9694-85151fbacab1', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:49:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd4cd741-9bb4-42b7-af6e-298de13e76f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:49:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd4cd741-9bb4-42b7-af6e-298de13e76f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:49:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476c0f1e-d9d5-478f-b79d-46cf04462a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:49:54 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Volume 5767caa7-8cb0-4aac-9694-85151fbacab1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5767caa7-8cb0-4aac-9694-85151fbacab1', 'volume_size': 1} Jun 24 09:49:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:49:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:49:54 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1142131315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5767caa7-8cb0-4aac-9694-85151fbacab1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5505cae9e92f4c3984ab5a4690d98ce3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:49:55Z,use_quota=True,user_id='7e694af5a61b4d97bc0ec0c9122bc5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:49:54 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Creating volume 5767caa7-8cb0-4aac-9694-85151fbacab1 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:49:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:49:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:49:54 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:49:54 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:49:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:49:54 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:49:54 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:49:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5767caa7-8cb0-4aac-9694-85151fbacab1 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:49:54 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5767caa7-8cb0-4aac-9694-85151fbacab1 1073741824 Jun 24 09:49:54 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:49:55 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Jun 24 09:49:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5767caa7-8cb0-4aac-9694-85151fbacab1 1073741824" returned: 0 in 0.921s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:49:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5767caa7-8cb0-4aac-9694-85151fbacab1 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:49:55 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5767caa7-8cb0-4aac-9694-85151fbacab1 Jun 24 09:49:55 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:49:56 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Jun 24 09:49:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5767caa7-8cb0-4aac-9694-85151fbacab1" returned: 0 in 0.667s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:49:56 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:49:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:49:56 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476c0f1e-d9d5-478f-b79d-46cf04462a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5767caa7-8cb0-4aac-9694-85151fbacab1', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:49:56 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (492815da-b858-4470-884a-9d6df41b5021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:49:56 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Volume volume-5767caa7-8cb0-4aac-9694-85151fbacab1 (5767caa7-8cb0-4aac-9694-85151fbacab1): created successfully Jun 24 09:49:56 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (492815da-b858-4470-884a-9d6df41b5021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:49:56 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Flow 'volume_create_manager' (28e6c0c1-fbc5-45b5-a6ff-2cf6e1589a9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:49:56 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-c540d30a-1184-4886-b2ec-cb38e1e9f044 tempest-VolumesTestJSON-1326848861 None] Created volume successfully. Jun 24 09:49:57 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:49:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Flow 'volume_create_manager' (b16ed0f6-dd59-42bf-933e-c327f2d99999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:49:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3344b3e2-6832-42dc-a054-5e80b0e89300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:49:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3344b3e2-6832-42dc-a054-5e80b0e89300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1239044464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8597c438-91d0-423e-a704-20346a498224,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5505cae9e92f4c3984ab5a4690d98ce3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:49:57Z,use_quota=True,user_id='7e694af5a61b4d97bc0ec0c9122bc5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:49:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fd6b4a-3c03-4013-8c4f-e68843f10237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:49:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fd6b4a-3c03-4013-8c4f-e68843f10237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:49:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3ec0a5-d824-4397-b9a8-7637141b837e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:49:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3ec0a5-d824-4397-b9a8-7637141b837e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8597c438-91d0-423e-a704-20346a498224', 'volume_name': 'volume-8597c438-91d0-423e-a704-20346a498224', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:49:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14bf6a17-d9ce-41b0-af2f-00704d36e910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:49:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14bf6a17-d9ce-41b0-af2f-00704d36e910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:49:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f86ad97-d3de-4ba6-b211-c7eb7b830d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:49:57 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Volume 8597c438-91d0-423e-a704-20346a498224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8597c438-91d0-423e-a704-20346a498224', 'volume_size': 1} Jun 24 09:49:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:49:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:49:57 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1239044464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8597c438-91d0-423e-a704-20346a498224,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5505cae9e92f4c3984ab5a4690d98ce3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:49:57Z,use_quota=True,user_id='7e694af5a61b4d97bc0ec0c9122bc5b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:49:57 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Creating volume 8597c438-91d0-423e-a704-20346a498224 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:49:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:49:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:49:57 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:49:57 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:49:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:49:57 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:49:57 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:49:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8597c438-91d0-423e-a704-20346a498224 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:49:57 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8597c438-91d0-423e-a704-20346a498224 1073741824 Jun 24 09:49:57 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:49:58 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Jun 24 09:49:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8597c438-91d0-423e-a704-20346a498224 1073741824" returned: 0 in 1.023s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:49:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8597c438-91d0-423e-a704-20346a498224 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:49:58 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8597c438-91d0-423e-a704-20346a498224 Jun 24 09:49:58 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:49:59 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Jun 24 09:49:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8597c438-91d0-423e-a704-20346a498224" returned: 0 in 0.788s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:49:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:49:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:49:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f86ad97-d3de-4ba6-b211-c7eb7b830d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8597c438-91d0-423e-a704-20346a498224', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:49:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (363c62a9-2dc6-4405-9bb6-a47daa80d4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:49:59 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Volume volume-8597c438-91d0-423e-a704-20346a498224 (8597c438-91d0-423e-a704-20346a498224): created successfully Jun 24 09:49:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (363c62a9-2dc6-4405-9bb6-a47daa80d4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:49:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Flow 'volume_create_manager' (b16ed0f6-dd59-42bf-933e-c327f2d99999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:49:59 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-399b6780-4ac1-4059-8855-ae6e14e99f94 tempest-VolumesTestJSON-1326848861 None] Created volume successfully. Jun 24 09:50:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d845e198-2424-4a19-9d9c-44fe99879179 tempest-VolumesTestJSON-1326848861 None] Acquiring lock "cinder-8597c438-91d0-423e-a704-20346a498224-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:50:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d845e198-2424-4a19-9d9c-44fe99879179 tempest-VolumesTestJSON-1326848861 None] Lock "cinder-8597c438-91d0-423e-a704-20346a498224-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:50:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d845e198-2424-4a19-9d9c-44fe99879179 tempest-VolumesTestJSON-1326848861 None] Acquiring lock "cinder-quobyte-8597c438-91d0-423e-a704-20346a498224" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:50:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d845e198-2424-4a19-9d9c-44fe99879179 tempest-VolumesTestJSON-1326848861 None] Lock "cinder-quobyte-8597c438-91d0-423e-a704-20346a498224" acquired by "delete_volume" :: waited 0.031s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:50:05 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[32031b20-1e09-41a8-b70e-b2245bdb212d]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:50:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d845e198-2424-4a19-9d9c-44fe99879179 tempest-VolumesTestJSON-1326848861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8597c438-91d0-423e-a704-20346a498224 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:05 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8597c438-91d0-423e-a704-20346a498224 Jun 24 09:50:05 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:06 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d845e198-2424-4a19-9d9c-44fe99879179 tempest-VolumesTestJSON-1326848861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8597c438-91d0-423e-a704-20346a498224" returned: 0 in 1.096s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d845e198-2424-4a19-9d9c-44fe99879179 tempest-VolumesTestJSON-1326848861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8597c438-91d0-423e-a704-20346a498224 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:06 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8597c438-91d0-423e-a704-20346a498224 Jun 24 09:50:06 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:07 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d845e198-2424-4a19-9d9c-44fe99879179 tempest-VolumesTestJSON-1326848861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8597c438-91d0-423e-a704-20346a498224" returned: 0 in 0.939s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:07 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d845e198-2424-4a19-9d9c-44fe99879179 tempest-VolumesTestJSON-1326848861 None] Lock "cinder-quobyte-8597c438-91d0-423e-a704-20346a498224" released by "delete_volume" :: held 2.114s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:50:07 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-d845e198-2424-4a19-9d9c-44fe99879179 tempest-VolumesTestJSON-1326848861 None] Created reservations ['0e4a6a1c-6d51-4ff6-83b4-b22ddcbfee1a', 'c9106dff-57b7-48a5-9dc4-f2f416c2d97f', 'f91c83d6-a601-4444-9c5d-63219513a682', '17a26484-4ebc-49f2-a7d0-c228612feeee'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:50:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d845e198-2424-4a19-9d9c-44fe99879179 tempest-VolumesTestJSON-1326848861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:50:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d845e198-2424-4a19-9d9c-44fe99879179 tempest-VolumesTestJSON-1326848861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:50:07 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d845e198-2424-4a19-9d9c-44fe99879179 tempest-VolumesTestJSON-1326848861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:50:07 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d845e198-2424-4a19-9d9c-44fe99879179 tempest-VolumesTestJSON-1326848861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:50:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d845e198-2424-4a19-9d9c-44fe99879179 tempest-VolumesTestJSON-1326848861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:50:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d845e198-2424-4a19-9d9c-44fe99879179 tempest-VolumesTestJSON-1326848861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:07 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:50:07 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:08 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d845e198-2424-4a19-9d9c-44fe99879179 tempest-VolumesTestJSON-1326848861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.696s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:08 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-d845e198-2424-4a19-9d9c-44fe99879179 tempest-VolumesTestJSON-1326848861 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:50:08 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-d845e198-2424-4a19-9d9c-44fe99879179 tempest-VolumesTestJSON-1326848861 None] Deleted volume successfully. Jun 24 09:50:08 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d845e198-2424-4a19-9d9c-44fe99879179 tempest-VolumesTestJSON-1326848861 None] Lock "cinder-8597c438-91d0-423e-a704-20346a498224-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:50:08 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5f273b48-27d3-4e67-afdd-7bc484368d2a tempest-VolumesTestJSON-1326848861 None] Acquiring lock "cinder-5767caa7-8cb0-4aac-9694-85151fbacab1-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:50:09 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5f273b48-27d3-4e67-afdd-7bc484368d2a tempest-VolumesTestJSON-1326848861 None] Lock "cinder-5767caa7-8cb0-4aac-9694-85151fbacab1-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:50:09 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5f273b48-27d3-4e67-afdd-7bc484368d2a tempest-VolumesTestJSON-1326848861 None] Acquiring lock "cinder-quobyte-5767caa7-8cb0-4aac-9694-85151fbacab1" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:50:09 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5f273b48-27d3-4e67-afdd-7bc484368d2a tempest-VolumesTestJSON-1326848861 None] Lock "cinder-quobyte-5767caa7-8cb0-4aac-9694-85151fbacab1" acquired by "delete_volume" :: waited 0.028s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:50:09 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11404f4-6367-4372-b639-1837efe05627]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:50:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5f273b48-27d3-4e67-afdd-7bc484368d2a tempest-VolumesTestJSON-1326848861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5767caa7-8cb0-4aac-9694-85151fbacab1 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:09 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5767caa7-8cb0-4aac-9694-85151fbacab1 Jun 24 09:50:09 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:10 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5f273b48-27d3-4e67-afdd-7bc484368d2a tempest-VolumesTestJSON-1326848861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5767caa7-8cb0-4aac-9694-85151fbacab1" returned: 0 in 1.285s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5f273b48-27d3-4e67-afdd-7bc484368d2a tempest-VolumesTestJSON-1326848861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5767caa7-8cb0-4aac-9694-85151fbacab1 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:10 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5767caa7-8cb0-4aac-9694-85151fbacab1 Jun 24 09:50:10 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:10 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-dcc95fe6-1349-4ce2-9bc4-2436e02ac233 tempest-AttachVolumeShelveTestJSON-1811866213 None] Acquiring lock "cinder-e4bfd5e7-454f-4bce-b222-e8412b950806-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:50:10 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-dcc95fe6-1349-4ce2-9bc4-2436e02ac233 tempest-AttachVolumeShelveTestJSON-1811866213 None] Lock "cinder-e4bfd5e7-454f-4bce-b222-e8412b950806-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:50:11 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-dcc95fe6-1349-4ce2-9bc4-2436e02ac233 tempest-AttachVolumeShelveTestJSON-1811866213 None] Acquiring lock "cinder-quobyte-e4bfd5e7-454f-4bce-b222-e8412b950806" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:50:11 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-dcc95fe6-1349-4ce2-9bc4-2436e02ac233 tempest-AttachVolumeShelveTestJSON-1811866213 None] Lock "cinder-quobyte-e4bfd5e7-454f-4bce-b222-e8412b950806" acquired by "delete_volume" :: waited 0.025s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:50:11 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cdce78-5254-4bb8-b7cd-e2edc3905f91]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:50:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dcc95fe6-1349-4ce2-9bc4-2436e02ac233 tempest-AttachVolumeShelveTestJSON-1811866213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e4bfd5e7-454f-4bce-b222-e8412b950806 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:11 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e4bfd5e7-454f-4bce-b222-e8412b950806 Jun 24 09:50:11 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:11 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5f273b48-27d3-4e67-afdd-7bc484368d2a tempest-VolumesTestJSON-1326848861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5767caa7-8cb0-4aac-9694-85151fbacab1" returned: 0 in 1.152s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:11 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5f273b48-27d3-4e67-afdd-7bc484368d2a tempest-VolumesTestJSON-1326848861 None] Lock "cinder-quobyte-5767caa7-8cb0-4aac-9694-85151fbacab1" released by "delete_volume" :: held 2.523s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:50:12 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-5f273b48-27d3-4e67-afdd-7bc484368d2a tempest-VolumesTestJSON-1326848861 None] Created reservations ['5f2e01b3-b1be-471e-adf4-04f346f727b3', '6f3b3084-5d22-42f8-9fdf-d3f2be68775c', '7d9c3cfc-060b-4d3e-820f-1e7abe7145d2', 'fd56c6ef-ac6f-42e2-b71f-0837ee161486'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:50:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-dc58a423-19d3-4211-8cb1-b5b223ead0fc tempest-ServerRescueNegativeTestJSON-473158836 None] Acquiring lock "cinder-e8179705-854a-4ea6-9b76-8310c9fce282-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:50:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-dc58a423-19d3-4211-8cb1-b5b223ead0fc tempest-ServerRescueNegativeTestJSON-473158836 None] Lock "cinder-e8179705-854a-4ea6-9b76-8310c9fce282-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:50:12 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dcc95fe6-1349-4ce2-9bc4-2436e02ac233 tempest-AttachVolumeShelveTestJSON-1811866213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e4bfd5e7-454f-4bce-b222-e8412b950806" returned: 0 in 1.650s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5f273b48-27d3-4e67-afdd-7bc484368d2a tempest-VolumesTestJSON-1326848861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:50:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5f273b48-27d3-4e67-afdd-7bc484368d2a tempest-VolumesTestJSON-1326848861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:50:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-5f273b48-27d3-4e67-afdd-7bc484368d2a tempest-VolumesTestJSON-1326848861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:50:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-5f273b48-27d3-4e67-afdd-7bc484368d2a tempest-VolumesTestJSON-1326848861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:50:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5f273b48-27d3-4e67-afdd-7bc484368d2a tempest-VolumesTestJSON-1326848861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:50:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5f273b48-27d3-4e67-afdd-7bc484368d2a tempest-VolumesTestJSON-1326848861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dcc95fe6-1349-4ce2-9bc4-2436e02ac233 tempest-AttachVolumeShelveTestJSON-1811866213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e4bfd5e7-454f-4bce-b222-e8412b950806 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:12 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:50:12 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:12 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e4bfd5e7-454f-4bce-b222-e8412b950806 Jun 24 09:50:12 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:13 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ac9ed10f-f91e-464a-93b3-1b7bcca733ed tempest-VolumesTestJSON-1326848861 None] Acquiring lock "cinder-6b006eb5-e767-4fa4-ad17-a65a7c43b206-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:50:13 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ac9ed10f-f91e-464a-93b3-1b7bcca733ed tempest-VolumesTestJSON-1326848861 None] Lock "cinder-6b006eb5-e767-4fa4-ad17-a65a7c43b206-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:50:13 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-dc58a423-19d3-4211-8cb1-b5b223ead0fc tempest-ServerRescueNegativeTestJSON-473158836 None] Acquiring lock "cinder-quobyte-e8179705-854a-4ea6-9b76-8310c9fce282" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:50:13 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-dc58a423-19d3-4211-8cb1-b5b223ead0fc tempest-ServerRescueNegativeTestJSON-473158836 None] Lock "cinder-quobyte-e8179705-854a-4ea6-9b76-8310c9fce282" acquired by "delete_volume" :: waited 0.065s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:50:13 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dcf6be-2377-458c-83ed-bc4dda24e469]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:50:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dc58a423-19d3-4211-8cb1-b5b223ead0fc tempest-ServerRescueNegativeTestJSON-473158836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e8179705-854a-4ea6-9b76-8310c9fce282 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:13 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ac9ed10f-f91e-464a-93b3-1b7bcca733ed tempest-VolumesTestJSON-1326848861 None] Acquiring lock "cinder-quobyte-6b006eb5-e767-4fa4-ad17-a65a7c43b206" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:50:13 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ac9ed10f-f91e-464a-93b3-1b7bcca733ed tempest-VolumesTestJSON-1326848861 None] Lock "cinder-quobyte-6b006eb5-e767-4fa4-ad17-a65a7c43b206" acquired by "delete_volume" :: waited 0.058s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:50:13 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d235519d-406c-4b4a-a689-756eaa8e979f]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:50:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac9ed10f-f91e-464a-93b3-1b7bcca733ed tempest-VolumesTestJSON-1326848861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6b006eb5-e767-4fa4-ad17-a65a7c43b206 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:13 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e8179705-854a-4ea6-9b76-8310c9fce282 Jun 24 09:50:13 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:13 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6b006eb5-e767-4fa4-ad17-a65a7c43b206 Jun 24 09:50:13 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:14 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dcc95fe6-1349-4ce2-9bc4-2436e02ac233 tempest-AttachVolumeShelveTestJSON-1811866213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e4bfd5e7-454f-4bce-b222-e8412b950806" returned: 0 in 1.214s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:14 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-dcc95fe6-1349-4ce2-9bc4-2436e02ac233 tempest-AttachVolumeShelveTestJSON-1811866213 None] Lock "cinder-quobyte-e4bfd5e7-454f-4bce-b222-e8412b950806" released by "delete_volume" :: held 2.982s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:50:14 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:14 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-dcc95fe6-1349-4ce2-9bc4-2436e02ac233 tempest-AttachVolumeShelveTestJSON-1811866213 None] Created reservations ['fb435018-507d-4213-820d-c92c9bf7742e', '9a5fb477-4053-4805-a6bd-ee8c6a6ee19d', '8ab2fff5-ea44-46c7-a272-3ae0629be472', '1828e70c-7ff0-4b42-8822-12d3d48b8d56'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:50:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5f273b48-27d3-4e67-afdd-7bc484368d2a tempest-VolumesTestJSON-1326848861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.494s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:14 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-5f273b48-27d3-4e67-afdd-7bc484368d2a tempest-VolumesTestJSON-1326848861 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:50:14 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-5f273b48-27d3-4e67-afdd-7bc484368d2a tempest-VolumesTestJSON-1326848861 None] Deleted volume successfully. Jun 24 09:50:14 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5f273b48-27d3-4e67-afdd-7bc484368d2a tempest-VolumesTestJSON-1326848861 None] Lock "cinder-5767caa7-8cb0-4aac-9694-85151fbacab1-delete_volume" released by "delete_volume" :: held 5.492s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:50:14 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dc58a423-19d3-4211-8cb1-b5b223ead0fc tempest-ServerRescueNegativeTestJSON-473158836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e8179705-854a-4ea6-9b76-8310c9fce282" returned: 0 in 1.295s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dc58a423-19d3-4211-8cb1-b5b223ead0fc tempest-ServerRescueNegativeTestJSON-473158836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e8179705-854a-4ea6-9b76-8310c9fce282 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:14 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e8179705-854a-4ea6-9b76-8310c9fce282 Jun 24 09:50:14 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-dcc95fe6-1349-4ce2-9bc4-2436e02ac233 tempest-AttachVolumeShelveTestJSON-1811866213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:50:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-dcc95fe6-1349-4ce2-9bc4-2436e02ac233 tempest-AttachVolumeShelveTestJSON-1811866213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:50:14 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-dcc95fe6-1349-4ce2-9bc4-2436e02ac233 tempest-AttachVolumeShelveTestJSON-1811866213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:50:14 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-dcc95fe6-1349-4ce2-9bc4-2436e02ac233 tempest-AttachVolumeShelveTestJSON-1811866213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:50:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-dcc95fe6-1349-4ce2-9bc4-2436e02ac233 tempest-AttachVolumeShelveTestJSON-1811866213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:50:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dcc95fe6-1349-4ce2-9bc4-2436e02ac233 tempest-AttachVolumeShelveTestJSON-1811866213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:14 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac9ed10f-f91e-464a-93b3-1b7bcca733ed tempest-VolumesTestJSON-1326848861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6b006eb5-e767-4fa4-ad17-a65a7c43b206" returned: 0 in 1.190s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac9ed10f-f91e-464a-93b3-1b7bcca733ed tempest-VolumesTestJSON-1326848861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6b006eb5-e767-4fa4-ad17-a65a7c43b206 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:14 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:50:14 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:14 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6b006eb5-e767-4fa4-ad17-a65a7c43b206 Jun 24 09:50:14 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:16 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dc58a423-19d3-4211-8cb1-b5b223ead0fc tempest-ServerRescueNegativeTestJSON-473158836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e8179705-854a-4ea6-9b76-8310c9fce282" returned: 0 in 1.485s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:16 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-dc58a423-19d3-4211-8cb1-b5b223ead0fc tempest-ServerRescueNegativeTestJSON-473158836 None] Lock "cinder-quobyte-e8179705-854a-4ea6-9b76-8310c9fce282" released by "delete_volume" :: held 2.889s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:50:16 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-dc58a423-19d3-4211-8cb1-b5b223ead0fc tempest-ServerRescueNegativeTestJSON-473158836 None] Created reservations ['39fed349-c0b5-419f-88aa-b537a0976dbd', '237123ca-4ae8-4b29-81e3-0a2ba4f2e862', '2f534359-db9a-41f5-a3a9-dad763183839', '4582b063-6adb-445f-9417-10238da18e28'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:50:16 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac9ed10f-f91e-464a-93b3-1b7bcca733ed tempest-VolumesTestJSON-1326848861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6b006eb5-e767-4fa4-ad17-a65a7c43b206" returned: 0 in 1.667s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:16 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ac9ed10f-f91e-464a-93b3-1b7bcca733ed tempest-VolumesTestJSON-1326848861 None] Lock "cinder-quobyte-6b006eb5-e767-4fa4-ad17-a65a7c43b206" released by "delete_volume" :: held 2.984s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:50:16 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-ac9ed10f-f91e-464a-93b3-1b7bcca733ed tempest-VolumesTestJSON-1326848861 None] Created reservations ['ac2d6bbf-43c8-4be7-afea-c27bae7186be', 'c0ddb449-f307-4675-a845-27f1b63fbdee', '88ad0121-4bb6-4de7-9f89-1381d9dc51cf', '042fe251-d2fc-4413-b50e-35f5ef93a827'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:50:16 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-dc58a423-19d3-4211-8cb1-b5b223ead0fc tempest-ServerRescueNegativeTestJSON-473158836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:50:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-dc58a423-19d3-4211-8cb1-b5b223ead0fc tempest-ServerRescueNegativeTestJSON-473158836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:50:16 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-dc58a423-19d3-4211-8cb1-b5b223ead0fc tempest-ServerRescueNegativeTestJSON-473158836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:50:16 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-dc58a423-19d3-4211-8cb1-b5b223ead0fc tempest-ServerRescueNegativeTestJSON-473158836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:50:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-dc58a423-19d3-4211-8cb1-b5b223ead0fc tempest-ServerRescueNegativeTestJSON-473158836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:50:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dc58a423-19d3-4211-8cb1-b5b223ead0fc tempest-ServerRescueNegativeTestJSON-473158836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dcc95fe6-1349-4ce2-9bc4-2436e02ac233 tempest-AttachVolumeShelveTestJSON-1811866213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 2.020s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:16 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-dcc95fe6-1349-4ce2-9bc4-2436e02ac233 tempest-AttachVolumeShelveTestJSON-1811866213 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:50:16 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-dcc95fe6-1349-4ce2-9bc4-2436e02ac233 tempest-AttachVolumeShelveTestJSON-1811866213 None] Deleted volume successfully. Jun 24 09:50:16 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:50:16 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:16 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-dcc95fe6-1349-4ce2-9bc4-2436e02ac233 tempest-AttachVolumeShelveTestJSON-1811866213 None] Lock "cinder-e4bfd5e7-454f-4bce-b222-e8412b950806-delete_volume" released by "delete_volume" :: held 6.092s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:50:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac9ed10f-f91e-464a-93b3-1b7bcca733ed tempest-VolumesTestJSON-1326848861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:50:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac9ed10f-f91e-464a-93b3-1b7bcca733ed tempest-VolumesTestJSON-1326848861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:50:16 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ac9ed10f-f91e-464a-93b3-1b7bcca733ed tempest-VolumesTestJSON-1326848861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:50:17 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ac9ed10f-f91e-464a-93b3-1b7bcca733ed tempest-VolumesTestJSON-1326848861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:50:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac9ed10f-f91e-464a-93b3-1b7bcca733ed tempest-VolumesTestJSON-1326848861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:50:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac9ed10f-f91e-464a-93b3-1b7bcca733ed tempest-VolumesTestJSON-1326848861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:17 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:50:17 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:18 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dc58a423-19d3-4211-8cb1-b5b223ead0fc tempest-ServerRescueNegativeTestJSON-473158836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 2.018s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:18 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-dc58a423-19d3-4211-8cb1-b5b223ead0fc tempest-ServerRescueNegativeTestJSON-473158836 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:50:19 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-dc58a423-19d3-4211-8cb1-b5b223ead0fc tempest-ServerRescueNegativeTestJSON-473158836 None] Deleted volume successfully. Jun 24 09:50:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac9ed10f-f91e-464a-93b3-1b7bcca733ed tempest-VolumesTestJSON-1326848861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 2.015s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:19 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:19 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-ac9ed10f-f91e-464a-93b3-1b7bcca733ed tempest-VolumesTestJSON-1326848861 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:50:19 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-ac9ed10f-f91e-464a-93b3-1b7bcca733ed tempest-VolumesTestJSON-1326848861 None] Deleted volume successfully. Jun 24 09:50:19 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-dc58a423-19d3-4211-8cb1-b5b223ead0fc tempest-ServerRescueNegativeTestJSON-473158836 None] Lock "cinder-e8179705-854a-4ea6-9b76-8310c9fce282-delete_volume" released by "delete_volume" :: held 6.619s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:50:19 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ac9ed10f-f91e-464a-93b3-1b7bcca733ed tempest-VolumesTestJSON-1326848861 None] Lock "cinder-6b006eb5-e767-4fa4-ad17-a65a7c43b206-delete_volume" released by "delete_volume" :: held 5.942s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:50:24 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:50:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:50:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:50:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:50:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:50:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:50:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:25 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:50:25 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:26 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.356s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:26 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:50:26 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:50:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 8 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 09:50:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 09:50:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0033b45f-2368-44c6-b26c-fc24e97c6dab tempest-BackendsCapabilitiesAdminTestsJSON-1226085106 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.737678527832, 'free_capacity_gb': 1775.737678527832, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93447) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 24 09:50:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9d24bf5e-b8f1-4b87-bb70-0e8d6a07638d tempest-BackendsCapabilitiesAdminTestsJSON-1226085106 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.737678527832, 'free_capacity_gb': 1775.737678527832, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93447) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 24 09:50:29 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=34,cinder:UPDATE=48,cinder:DELETE=4,cinder:INSERT=10 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:50:29 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:UPDATE=64,cinder:SELECT=39,cinder:INSERT=17,cinder:DELETE=5 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:50:36 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-fb4287ce-d1af-4b08-8ce4-498e81e0a5e5 tempest-GroupsV314Test-1803619899 None] Group tempest-GroupsV314Test-Group-910924686: creating Jun 24 09:50:36 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-fb4287ce-d1af-4b08-8ce4-498e81e0a5e5 tempest-GroupsV314Test-1803619899 None] Group tempest-GroupsV314Test-Group-910924686: created successfully Jun 24 09:50:36 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-fb4287ce-d1af-4b08-8ce4-498e81e0a5e5 tempest-GroupsV314Test-1803619899 None] Create group completed successfully. Jun 24 09:50:38 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:50:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Flow 'volume_create_manager' (bde97a28-781a-4e5b-a57f-e021bd677737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:50:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637c0f5c-2c05-41c4-b082-7db3cd17084b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:50:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637c0f5c-2c05-41c4-b082-7db3cd17084b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1700866278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dbcb08a8-c36a-4511-adc7-ef674ec82ac5,host='devstack@QuobyteHD#QuobyteHD',id=2b11eeda-3902-4287-b2cb-bfcc7bf22459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf4c80f1c244bf2af3ba0c5760a968c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:50:38Z,use_quota=True,user_id='2dffd9a5b4064e8db2704ad9805fa0f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cb51056-2fc2-443d-b3ce-173ac442ff84),volume_type_id=5cb51056-2fc2-443d-b3ce-173ac442ff84)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:50:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd94b159-0211-4985-8381-a469aeedee41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:50:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd94b159-0211-4985-8381-a469aeedee41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:50:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8b76b9-7022-4f8c-b064-c412b2c6ca9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:50:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8b76b9-7022-4f8c-b064-c412b2c6ca9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b11eeda-3902-4287-b2cb-bfcc7bf22459', 'volume_name': 'volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:50:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b2a82d-a38f-4163-824c-58b5d2d5eaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:50:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13b2a82d-a38f-4163-824c-58b5d2d5eaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:50:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff3ce654-3524-412e-b482-0a85b76f444e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:50:38 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Volume 2b11eeda-3902-4287-b2cb-bfcc7bf22459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459', 'volume_size': 1} Jun 24 09:50:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:50:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:50:38 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dbcb08a8-c36a-4511-adc7-ef674ec82ac5,created_at=2026-06-24T07:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1700866278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dbcb08a8-c36a-4511-adc7-ef674ec82ac5,host='devstack@QuobyteHD#QuobyteHD',id=2b11eeda-3902-4287-b2cb-bfcc7bf22459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf4c80f1c244bf2af3ba0c5760a968c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:50:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:50:38Z,use_quota=True,user_id='2dffd9a5b4064e8db2704ad9805fa0f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cb51056-2fc2-443d-b3ce-173ac442ff84),volume_type_id=5cb51056-2fc2-443d-b3ce-173ac442ff84)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:50:38 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Creating volume 2b11eeda-3902-4287-b2cb-bfcc7bf22459 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:50:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:50:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:50:38 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:50:38 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:50:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:50:38 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:50:38 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:50:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:38 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 1073741824 Jun 24 09:50:38 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:39 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 1073741824" returned: 0 in 1.021s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:39 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 Jun 24 09:50:39 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:40 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459" returned: 0 in 0.783s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:50:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:50:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff3ce654-3524-412e-b482-0a85b76f444e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:50:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0c6d7e-6452-44f6-bfc4-980523e3698d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:50:40 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Volume volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 (2b11eeda-3902-4287-b2cb-bfcc7bf22459): created successfully Jun 24 09:50:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce0c6d7e-6452-44f6-bfc4-980523e3698d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:50:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Flow 'volume_create_manager' (bde97a28-781a-4e5b-a57f-e021bd677737) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:50:40 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-0253da1c-d32a-456a-a6d7-e485b98060b0 tempest-GroupsV314Test-1803619899 None] Created volume successfully. Jun 24 09:50:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:50:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:50:41 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Cloning volume 2b11eeda-3902-4287-b2cb-bfcc7bf22459 to volume 6d1eb6f0-ae60-4172-9caf-a0a7d2f26a6a Jun 24 09:50:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Creating offline snapshot 915d6df4-5dc8-4bb0-adb6-d7f84535d232 of volume 2b11eeda-3902-4287-b2cb-bfcc7bf22459 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 09:50:42 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a0f6c8-76d8-4d70-9a8b-091ff17fe21d]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:50:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:42 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 Jun 24 09:50:42 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:43 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:50:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Flow 'volume_create_manager' (b813f952-d6fc-439b-b796-e9ecb73c7f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:50:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc992e8-6b4e-4900-a6ca-36a11517de25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:50:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc992e8-6b4e-4900-a6ca-36a11517de25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-711830944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bec2754-f89f-4dc7-a6d4-f7cba550a5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8574cb4538ed4694bb436a999b118f4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:50:43Z,use_quota=True,user_id='15f41a1d662343f097ed20cdbc4116f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:50:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f800105c-534c-4fac-b8ec-12e83ba83005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:50:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f800105c-534c-4fac-b8ec-12e83ba83005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:50:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c941839b-6a53-4e51-903d-670a3acc4c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:50:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c941839b-6a53-4e51-903d-670a3acc4c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bec2754-f89f-4dc7-a6d4-f7cba550a5fd', 'volume_name': 'volume-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:50:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8d395e-0393-4a23-b7d1-508845d60ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:50:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8d395e-0393-4a23-b7d1-508845d60ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:50:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703f3c3d-a074-4c0e-a8f8-bc7cbdf4bd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:50:43 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Volume 3bec2754-f89f-4dc7-a6d4-f7cba550a5fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd', 'volume_size': 1} Jun 24 09:50:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:50:43 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459" returned: 0 in 1.168s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.915d6df4-5dc8-4bb0-adb6-d7f84535d232 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:43 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.915d6df4-5dc8-4bb0-adb6-d7f84535d232 1G Jun 24 09:50:43 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:44 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.915d6df4-5dc8-4bb0-adb6-d7f84535d232 1G" returned: 0 in 0.923s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.915d6df4-5dc8-4bb0-adb6-d7f84535d232 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:44 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.915d6df4-5dc8-4bb0-adb6-d7f84535d232 Jun 24 09:50:44 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:44 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.915d6df4-5dc8-4bb0-adb6-d7f84535d232" returned: 0 in 0.770s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:44 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.915d6df4-5dc8-4bb0-adb6-d7f84535d232 is being set with open permissions: ugo+rw: NotImplementedError Jun 24 09:50:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.915d6df4-5dc8-4bb0-adb6-d7f84535d232 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:44 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.915d6df4-5dc8-4bb0-adb6-d7f84535d232 Jun 24 09:50:44 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:44 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:50:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Flow 'volume_create_manager' (db9e4685-adfb-41ad-9e62-878483125508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:50:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d86db6-5f67-490a-9b19-1b60a0a286f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:50:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d86db6-5f67-490a-9b19-1b60a0a286f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1142380917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71ff36efac8943fdb2e8124efc0c60f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:50:45Z,use_quota=True,user_id='4cbc5b1fde984382b3d7a2045e0c19a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:50:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d9f85d-1c10-4934-a7cc-3d2a9a25cc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:50:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d9f85d-1c10-4934-a7cc-3d2a9a25cc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:50:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ccfa4cb-7eb0-41b8-a2a7-7969ad132a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:50:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ccfa4cb-7eb0-41b8-a2a7-7969ad132a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a', 'volume_name': 'volume-27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:50:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f45707-9869-4985-b4f5-57bfe009b963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:50:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f45707-9869-4985-b4f5-57bfe009b963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:50:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c66be6-cc6f-4730-bfaa-ff3bc992f478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:50:45 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Volume 27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a', 'volume_size': 1} Jun 24 09:50:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:50:45 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.915d6df4-5dc8-4bb0-adb6-d7f84535d232" returned: 0 in 0.730s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:45 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.info Jun 24 09:50:45 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:46 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.info" returned: 0 in 0.690s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:46 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.info is being set with open permissions: ugo+rw: NotImplementedError Jun 24 09:50:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:46 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.info Jun 24 09:50:46 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:47 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.info" returned: 0 in 0.658s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Acquiring lock "cinder-quobyte-6d1eb6f0-ae60-4172-9caf-a0a7d2f26a6a" by "_copy_volume_from_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:50:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Lock "cinder-quobyte-6d1eb6f0-ae60-4172-9caf-a0a7d2f26a6a" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:50:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] snapshot: 915d6df4-5dc8-4bb0-adb6-d7f84535d232, volume: 6d1eb6f0-ae60-4172-9caf-a0a7d2f26a6a, {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 09:50:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:50:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:50:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:50:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:50:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:50:47 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0015f66-b921-440f-9451-67900a92a2fa]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:50:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.915d6df4-5dc8-4bb0-adb6-d7f84535d232 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:47 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.915d6df4-5dc8-4bb0-adb6-d7f84535d232 Jun 24 09:50:47 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:47 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.915d6df4-5dc8-4bb0-adb6-d7f84535d232" returned: 0 in 0.791s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:50:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 09:50:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Creating direct copy from snapshot {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 09:50:47 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7fc19a-e515-46c0-8647-63ec432e6214]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:50:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:48 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 Jun 24 09:50:48 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:48 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459" returned: 0 in 0.770s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:48 devstack cinder-volume[93447]: DEBUG cinder.utils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Path /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6d1eb6f0-ae60-4172-9caf-a0a7d2f26a6a not found in is_blk_device check {{(pid=93447) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 09:50:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6d1eb6f0-ae60-4172-9caf-a0a7d2f26a6a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:48 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6d1eb6f0-ae60-4172-9caf-a0a7d2f26a6a Jun 24 09:50:48 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:54 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6d1eb6f0-ae60-4172-9caf-a0a7d2f26a6a" returned: 0 in 6.224s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:54 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fd2db7-1cbe-4b21-b6f6-9131a86503aa]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:50:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:55 devstack sudo[99969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 Jun 24 09:50:55 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:55 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=11,cinder:UPDATE=9 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:50:55 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3,cinder:INSERT=3,cinder:DELETE=1 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:50:55 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459" returned: 0 in 0.904s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:55 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6d1eb6f0-ae60-4172-9caf-a0a7d2f26a6a {{(pid=93447) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 09:50:55 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Converted 1024.00 MB image at 164.50 MB/s Jun 24 09:50:55 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6d1eb6f0-ae60-4172-9caf-a0a7d2f26a6a is being set with open permissions: ugo+rw: NotImplementedError Jun 24 09:50:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6d1eb6f0-ae60-4172-9caf-a0a7d2f26a6a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:55 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6d1eb6f0-ae60-4172-9caf-a0a7d2f26a6a Jun 24 09:50:55 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:56 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6d1eb6f0-ae60-4172-9caf-a0a7d2f26a6a" returned: 0 in 0.637s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:56 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Lock "cinder-quobyte-6d1eb6f0-ae60-4172-9caf-a0a7d2f26a6a" released by "_copy_volume_from_snapshot" :: held 9.427s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:50:56 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Acquiring lock "cinder-quobyte-915d6df4-5dc8-4bb0-adb6-d7f84535d232" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:50:56 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Lock "cinder-quobyte-915d6df4-5dc8-4bb0-adb6-d7f84535d232" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:50:56 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Deleting offline snapshot 915d6df4-5dc8-4bb0-adb6-d7f84535d232 of volume 2b11eeda-3902-4287-b2cb-bfcc7bf22459 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 09:50:56 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] snapshot_file for this snap is: volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.915d6df4-5dc8-4bb0-adb6-d7f84535d232 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 09:50:56 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95944df-9007-4cca-8fac-136783c9ef48]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:50:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.915d6df4-5dc8-4bb0-adb6-d7f84535d232 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:56 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.915d6df4-5dc8-4bb0-adb6-d7f84535d232 Jun 24 09:50:56 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:57 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.915d6df4-5dc8-4bb0-adb6-d7f84535d232" returned: 0 in 0.723s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:57 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:50:57 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[92804cef-fbc5-4e90-a46a-1a3d2520bab3]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:50:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:57 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 Jun 24 09:50:57 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:58 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459" returned: 0 in 0.808s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.915d6df4-5dc8-4bb0-adb6-d7f84535d232 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:58 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.915d6df4-5dc8-4bb0-adb6-d7f84535d232 Jun 24 09:50:58 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:58 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.915d6df4-5dc8-4bb0-adb6-d7f84535d232" returned: 0 in 0.758s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.915d6df4-5dc8-4bb0-adb6-d7f84535d232 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:58 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.915d6df4-5dc8-4bb0-adb6-d7f84535d232 Jun 24 09:50:58 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:59 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Jun 24 09:50:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459.915d6df4-5dc8-4bb0-adb6-d7f84535d232" returned: 0 in 0.654s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:50:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Lock "cinder-quobyte-915d6df4-5dc8-4bb0-adb6-d7f84535d232" released by "_delete_snapshot" :: held 3.050s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:50:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.703s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:50:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.476s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:50:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-711830944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bec2754-f89f-4dc7-a6d4-f7cba550a5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8574cb4538ed4694bb436a999b118f4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:50:43Z,use_quota=True,user_id='15f41a1d662343f097ed20cdbc4116f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:50:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Creating volume 3bec2754-f89f-4dc7-a6d4-f7cba550a5fd {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:50:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:50:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:50:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:50:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:50:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:50:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:50:59 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:50:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:50:59 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd 1073741824 Jun 24 09:50:59 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:50:59 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-1ea849af-1b77-455d-9384-8fd5c33524df tempest-GroupsV314Test-1803619899 None] Create group from source-group-dbcb08a8-c36a-4511-adc7-ef674ec82ac5 completed successfully. Jun 24 09:51:00 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-170c2845-0088-4ae7-988e-8cad52af6837 tempest-GroupsV314Test-1803619899 None] Acquiring lock "cinder-quobyte-6d1eb6f0-ae60-4172-9caf-a0a7d2f26a6a" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:51:00 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-170c2845-0088-4ae7-988e-8cad52af6837 tempest-GroupsV314Test-1803619899 None] Lock "cinder-quobyte-6d1eb6f0-ae60-4172-9caf-a0a7d2f26a6a" acquired by "delete_volume" :: waited 0.025s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:51:01 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a9395b-4e53-4ed5-8dc4-62923ab48d4b]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:51:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-170c2845-0088-4ae7-988e-8cad52af6837 tempest-GroupsV314Test-1803619899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6d1eb6f0-ae60-4172-9caf-a0a7d2f26a6a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:01 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd 1073741824" returned: 0 in 1.437s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:01 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd Jun 24 09:51:01 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:01 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6d1eb6f0-ae60-4172-9caf-a0a7d2f26a6a Jun 24 09:51:01 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:01 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd" returned: 0 in 0.854s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:01 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] <== create_volume: return (2358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:51:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.362s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:51:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.925s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:51:01 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1142380917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='71ff36efac8943fdb2e8124efc0c60f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:50:45Z,use_quota=True,user_id='4cbc5b1fde984382b3d7a2045e0c19a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:51:01 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Creating volume 27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:51:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:51:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:51:01 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:51:01 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:51:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:51:01 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:51:01 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:51:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:01 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-170c2845-0088-4ae7-988e-8cad52af6837 tempest-GroupsV314Test-1803619899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6d1eb6f0-ae60-4172-9caf-a0a7d2f26a6a" returned: 0 in 0.999s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-170c2845-0088-4ae7-988e-8cad52af6837 tempest-GroupsV314Test-1803619899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6d1eb6f0-ae60-4172-9caf-a0a7d2f26a6a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:02 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a 1073741824 Jun 24 09:51:02 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:02 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703f3c3d-a074-4c0e-a8f8-bc7cbdf4bd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:02 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6d1eb6f0-ae60-4172-9caf-a0a7d2f26a6a Jun 24 09:51:02 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:02 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b298739-ec48-4acf-969f-1df68973298c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:02 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Volume volume-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd (3bec2754-f89f-4dc7-a6d4-f7cba550a5fd): created successfully Jun 24 09:51:02 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b298739-ec48-4acf-969f-1df68973298c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:02 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Flow 'volume_create_manager' (b813f952-d6fc-439b-b796-e9ecb73c7f3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:51:02 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-c478b567-6875-4b38-8e2e-c9363554f9b8 tempest-AttachVolumeNegativeTest-2082640456 None] Created volume successfully. Jun 24 09:51:02 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-170c2845-0088-4ae7-988e-8cad52af6837 tempest-GroupsV314Test-1803619899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6d1eb6f0-ae60-4172-9caf-a0a7d2f26a6a" returned: 0 in 0.968s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:03 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-170c2845-0088-4ae7-988e-8cad52af6837 tempest-GroupsV314Test-1803619899 None] Lock "cinder-quobyte-6d1eb6f0-ae60-4172-9caf-a0a7d2f26a6a" released by "delete_volume" :: held 2.051s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:51:03 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-170c2845-0088-4ae7-988e-8cad52af6837 tempest-GroupsV314Test-1803619899 None] Created reservations ['abdc31aa-9eb3-4a7a-8585-f7da95eb25e5'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:51:03 devstack cinder-volume[93447]: WARNING cinder.quota [None req-170c2845-0088-4ae7-988e-8cad52af6837 tempest-GroupsV314Test-1803619899 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1443095696 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1443095696, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:51:03 devstack cinder-volume[93447]: WARNING cinder.quota [None req-170c2845-0088-4ae7-988e-8cad52af6837 tempest-GroupsV314Test-1803619899 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1443095696 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1443095696, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:51:03 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-170c2845-0088-4ae7-988e-8cad52af6837 tempest-GroupsV314Test-1803619899 None] Created reservations ['46a071f5-675c-4818-bbb1-5dc7881d2a1c', '188edf5a-257e-4290-b65f-060a1079b1cb', '15f8416c-b4c4-4d84-ad17-fb710663a5f1', '5d6485c9-1f44-4e40-bc22-ca2d01d23767'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:51:03 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a 1073741824" returned: 0 in 1.245s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:03 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a Jun 24 09:51:03 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-170c2845-0088-4ae7-988e-8cad52af6837 tempest-GroupsV314Test-1803619899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:51:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-170c2845-0088-4ae7-988e-8cad52af6837 tempest-GroupsV314Test-1803619899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:51:03 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-170c2845-0088-4ae7-988e-8cad52af6837 tempest-GroupsV314Test-1803619899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:51:03 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-170c2845-0088-4ae7-988e-8cad52af6837 tempest-GroupsV314Test-1803619899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:51:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-170c2845-0088-4ae7-988e-8cad52af6837 tempest-GroupsV314Test-1803619899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:51:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-170c2845-0088-4ae7-988e-8cad52af6837 tempest-GroupsV314Test-1803619899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:03 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:51:03 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:04 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7c4d00a1-f3f7-45aa-888f-381ed9b48a7d tempest-GroupsV314Test-1803619899 None] Acquiring lock "cinder-quobyte-2b11eeda-3902-4287-b2cb-bfcc7bf22459" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:51:04 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7c4d00a1-f3f7-45aa-888f-381ed9b48a7d tempest-GroupsV314Test-1803619899 None] Lock "cinder-quobyte-2b11eeda-3902-4287-b2cb-bfcc7bf22459" acquired by "delete_volume" :: waited 0.039s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:51:04 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c722503a-ac74-42b0-a8b9-0bf4a46e4e01]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:51:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7c4d00a1-f3f7-45aa-888f-381ed9b48a7d tempest-GroupsV314Test-1803619899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:04 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a" returned: 0 in 1.124s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:04 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 Jun 24 09:51:04 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:04 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] <== create_volume: return (2435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:51:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.444s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:51:04 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c66be6-cc6f-4730-bfaa-ff3bc992f478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d87b75-46f0-4b0a-b9c7-b412537b2105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-170c2845-0088-4ae7-988e-8cad52af6837 tempest-GroupsV314Test-1803619899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.041s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:04 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-170c2845-0088-4ae7-988e-8cad52af6837 tempest-GroupsV314Test-1803619899 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:51:04 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-170c2845-0088-4ae7-988e-8cad52af6837 tempest-GroupsV314Test-1803619899 None] Delete group completed successfully. Jun 24 09:51:04 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Volume volume-27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a (27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a): created successfully Jun 24 09:51:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d87b75-46f0-4b0a-b9c7-b412537b2105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Flow 'volume_create_manager' (db9e4685-adfb-41ad-9e62-878483125508) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:51:04 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-96341c34-dc5e-4a4e-a036-e163e7b8b083 req-159be18d-db48-4433-b002-e22e57a534ef tempest-VolumesGetTestJSON-223041003 None] Created volume successfully. Jun 24 09:51:05 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7c4d00a1-f3f7-45aa-888f-381ed9b48a7d tempest-GroupsV314Test-1803619899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459" returned: 0 in 0.927s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7c4d00a1-f3f7-45aa-888f-381ed9b48a7d tempest-GroupsV314Test-1803619899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:05 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459 Jun 24 09:51:05 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-8be6a903-6bcf-44a9-abff-901d1e3f21b0 req-b8e6b1da-460c-44fa-962a-4b98ab7b3500 tempest-VolumesGetTestJSON-223041003 None] Acquiring lock "cinder-27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:51:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-8be6a903-6bcf-44a9-abff-901d1e3f21b0 req-b8e6b1da-460c-44fa-962a-4b98ab7b3500 tempest-VolumesGetTestJSON-223041003 None] Lock "cinder-27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:51:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-8be6a903-6bcf-44a9-abff-901d1e3f21b0 req-b8e6b1da-460c-44fa-962a-4b98ab7b3500 tempest-VolumesGetTestJSON-223041003 None] Acquiring lock "cinder-quobyte-27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:51:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-8be6a903-6bcf-44a9-abff-901d1e3f21b0 req-b8e6b1da-460c-44fa-962a-4b98ab7b3500 tempest-VolumesGetTestJSON-223041003 None] Lock "cinder-quobyte-27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a" acquired by "delete_volume" :: waited 0.023s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:51:05 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb58d07-096d-473c-97eb-74f1714d5437]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:51:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-8be6a903-6bcf-44a9-abff-901d1e3f21b0 req-b8e6b1da-460c-44fa-962a-4b98ab7b3500 tempest-VolumesGetTestJSON-223041003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:06 devstack sudo[100133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a Jun 24 09:51:06 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:06 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7c4d00a1-f3f7-45aa-888f-381ed9b48a7d tempest-GroupsV314Test-1803619899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2b11eeda-3902-4287-b2cb-bfcc7bf22459" returned: 0 in 0.929s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:06 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7c4d00a1-f3f7-45aa-888f-381ed9b48a7d tempest-GroupsV314Test-1803619899 None] Lock "cinder-quobyte-2b11eeda-3902-4287-b2cb-bfcc7bf22459" released by "delete_volume" :: held 1.994s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:51:06 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-7c4d00a1-f3f7-45aa-888f-381ed9b48a7d tempest-GroupsV314Test-1803619899 None] Created reservations ['2b570f15-a5da-4dcc-a2ee-e86ae9efee83'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:51:06 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-7c4d00a1-f3f7-45aa-888f-381ed9b48a7d tempest-GroupsV314Test-1803619899 None] Created reservations ['c50f5815-f82f-4641-97aa-063c37888f59', 'bd6a49b0-31a4-4790-9d81-4b942ff9ef39', '7984a855-de4b-4044-a366-ac46f04d37c8', '98a23ef3-fc16-4fe1-b12d-0db7dc4c6487'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:51:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-88dd5f09-2470-47ff-95e3-797954949a0d req-7738c9f8-ddf8-4078-8c38-6c96bcaf41ca tempest-AttachVolumeNegativeTest-2082640456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:51:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-88dd5f09-2470-47ff-95e3-797954949a0d req-7738c9f8-ddf8-4078-8c38-6c96bcaf41ca tempest-AttachVolumeNegativeTest-2082640456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:51:06 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd53529d-cdc6-4517-b9b9-a47149ca71ac]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:51:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-88dd5f09-2470-47ff-95e3-797954949a0d req-7738c9f8-ddf8-4078-8c38-6c96bcaf41ca tempest-AttachVolumeNegativeTest-2082640456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7c4d00a1-f3f7-45aa-888f-381ed9b48a7d tempest-GroupsV314Test-1803619899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:51:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7c4d00a1-f3f7-45aa-888f-381ed9b48a7d tempest-GroupsV314Test-1803619899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:51:06 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7c4d00a1-f3f7-45aa-888f-381ed9b48a7d tempest-GroupsV314Test-1803619899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:51:06 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7c4d00a1-f3f7-45aa-888f-381ed9b48a7d tempest-GroupsV314Test-1803619899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:51:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7c4d00a1-f3f7-45aa-888f-381ed9b48a7d tempest-GroupsV314Test-1803619899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:51:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7c4d00a1-f3f7-45aa-888f-381ed9b48a7d tempest-GroupsV314Test-1803619899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:06 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd Jun 24 09:51:06 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:06 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:51:06 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:07 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-8be6a903-6bcf-44a9-abff-901d1e3f21b0 req-b8e6b1da-460c-44fa-962a-4b98ab7b3500 tempest-VolumesGetTestJSON-223041003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a" returned: 0 in 1.273s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-8be6a903-6bcf-44a9-abff-901d1e3f21b0 req-b8e6b1da-460c-44fa-962a-4b98ab7b3500 tempest-VolumesGetTestJSON-223041003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:07 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a Jun 24 09:51:07 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:07 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7c4d00a1-f3f7-45aa-888f-381ed9b48a7d tempest-GroupsV314Test-1803619899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.209s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:07 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-7c4d00a1-f3f7-45aa-888f-381ed9b48a7d tempest-GroupsV314Test-1803619899 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:51:07 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-7c4d00a1-f3f7-45aa-888f-381ed9b48a7d tempest-GroupsV314Test-1803619899 None] Delete group completed successfully. Jun 24 09:51:07 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-88dd5f09-2470-47ff-95e3-797954949a0d req-7738c9f8-ddf8-4078-8c38-6c96bcaf41ca tempest-AttachVolumeNegativeTest-2082640456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd" returned: 0 in 1.389s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-88dd5f09-2470-47ff-95e3-797954949a0d req-7738c9f8-ddf8-4078-8c38-6c96bcaf41ca tempest-AttachVolumeNegativeTest-2082640456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.410s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:51:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-88dd5f09-2470-47ff-95e3-797954949a0d req-7738c9f8-ddf8-4078-8c38-6c96bcaf41ca tempest-AttachVolumeNegativeTest-2082640456 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb', 'name': 'volume-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8bb857a1-ad9e-4e65-9227-97c827ccbd49', 'enforce_multipath': True} {{(pid=93447) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 09:51:07 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-88dd5f09-2470-47ff-95e3-797954949a0d req-7738c9f8-ddf8-4078-8c38-6c96bcaf41ca tempest-AttachVolumeNegativeTest-2082640456 None] attachment_update completed successfully. Jun 24 09:51:08 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-8be6a903-6bcf-44a9-abff-901d1e3f21b0 req-b8e6b1da-460c-44fa-962a-4b98ab7b3500 tempest-VolumesGetTestJSON-223041003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a" returned: 0 in 0.880s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:08 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-8be6a903-6bcf-44a9-abff-901d1e3f21b0 req-b8e6b1da-460c-44fa-962a-4b98ab7b3500 tempest-VolumesGetTestJSON-223041003 None] Lock "cinder-quobyte-27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a" released by "delete_volume" :: held 2.229s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:51:08 devstack cinder-volume[93447]: DEBUG cinder.quota [req-8be6a903-6bcf-44a9-abff-901d1e3f21b0 req-b8e6b1da-460c-44fa-962a-4b98ab7b3500 tempest-VolumesGetTestJSON-223041003 None] Created reservations ['596dc6af-692d-4d31-898a-49ebde323df8', '887a062f-3839-46c2-9d2e-a94452d3e4e1', 'c2fda23d-70ff-4629-bfe2-1ac631bc1b36', '434a5048-4b93-45d2-8651-6452a96de414'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:51:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-8be6a903-6bcf-44a9-abff-901d1e3f21b0 req-b8e6b1da-460c-44fa-962a-4b98ab7b3500 tempest-VolumesGetTestJSON-223041003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:51:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-8be6a903-6bcf-44a9-abff-901d1e3f21b0 req-b8e6b1da-460c-44fa-962a-4b98ab7b3500 tempest-VolumesGetTestJSON-223041003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:51:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [req-8be6a903-6bcf-44a9-abff-901d1e3f21b0 req-b8e6b1da-460c-44fa-962a-4b98ab7b3500 tempest-VolumesGetTestJSON-223041003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:51:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [req-8be6a903-6bcf-44a9-abff-901d1e3f21b0 req-b8e6b1da-460c-44fa-962a-4b98ab7b3500 tempest-VolumesGetTestJSON-223041003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:51:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-8be6a903-6bcf-44a9-abff-901d1e3f21b0 req-b8e6b1da-460c-44fa-962a-4b98ab7b3500 tempest-VolumesGetTestJSON-223041003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:51:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-8be6a903-6bcf-44a9-abff-901d1e3f21b0 req-b8e6b1da-460c-44fa-962a-4b98ab7b3500 tempest-VolumesGetTestJSON-223041003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:08 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:51:08 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:09 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-8be6a903-6bcf-44a9-abff-901d1e3f21b0 req-b8e6b1da-460c-44fa-962a-4b98ab7b3500 tempest-VolumesGetTestJSON-223041003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.016s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:09 devstack cinder-volume[93447]: DEBUG cinder.manager [req-8be6a903-6bcf-44a9-abff-901d1e3f21b0 req-b8e6b1da-460c-44fa-962a-4b98ab7b3500 tempest-VolumesGetTestJSON-223041003 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:51:09 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-8be6a903-6bcf-44a9-abff-901d1e3f21b0 req-b8e6b1da-460c-44fa-962a-4b98ab7b3500 tempest-VolumesGetTestJSON-223041003 None] Deleted volume successfully. Jun 24 09:51:09 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-8be6a903-6bcf-44a9-abff-901d1e3f21b0 req-b8e6b1da-460c-44fa-962a-4b98ab7b3500 tempest-VolumesGetTestJSON-223041003 None] Lock "cinder-27d5d212-cb3f-43e1-bcf4-11a50b1bfb4a-delete_volume" released by "delete_volume" :: held 3.577s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:51:15 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-60224bee-ac56-4675-9adf-36771358e907 req-b0dfcba6-7690-4551-8ca5-9c4c1cc00498 tempest-AttachVolumeNegativeTest-2082640456 None] Terminate volume connection completed successfully. Jun 24 09:51:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-60224bee-ac56-4675-9adf-36771358e907 req-b0dfcba6-7690-4551-8ca5-9c4c1cc00498 tempest-AttachVolumeNegativeTest-2082640456 None] Deleting attachment 8bb857a1-ad9e-4e65-9227-97c827ccbd49. {{(pid=93447) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 09:51:17 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-303297eb-2333-4f36-af69-492848b1c606 tempest-GroupSnapshotsV319Test-31374041 None] Group tempest-GroupSnapshotsV319Test-Group-1092997457: creating Jun 24 09:51:17 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-303297eb-2333-4f36-af69-492848b1c606 tempest-GroupSnapshotsV319Test-31374041 None] Group tempest-GroupSnapshotsV319Test-Group-1092997457: created successfully Jun 24 09:51:17 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-303297eb-2333-4f36-af69-492848b1c606 tempest-GroupSnapshotsV319Test-31374041 None] Create group completed successfully. Jun 24 09:51:19 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:51:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Flow 'volume_create_manager' (744bbb61-3c00-42b3-8f8a-888d58f3dc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:51:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3bddfe-28f9-4311-be97-c056b9a29e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3bddfe-28f9-4311-be97-c056b9a29e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1818677207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66542450-e849-44f7-aeec-5c2e6f7c81b4,host='devstack@QuobyteHD#QuobyteHD',id=88c7092f-a0c0-4780-a979-321b44150fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba582ad1da746978a8c0307f77d63aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:51:19Z,use_quota=True,user_id='4e0648451c844744ba1efc6a2c88b89f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0dc843ca-c9f8-4f5f-b1ff-7f51081e86da),volume_type_id=0dc843ca-c9f8-4f5f-b1ff-7f51081e86da)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3274337c-ca75-4e8d-83bb-5c051393e4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3274337c-ca75-4e8d-83bb-5c051393e4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (418b508a-e9a0-486c-9a48-fd5ad9e0edb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (418b508a-e9a0-486c-9a48-fd5ad9e0edb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88c7092f-a0c0-4780-a979-321b44150fa0', 'volume_name': 'volume-88c7092f-a0c0-4780-a979-321b44150fa0', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57875b72-204a-46c3-bd9c-a3feb5e45970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57875b72-204a-46c3-bd9c-a3feb5e45970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1e455e-557c-4264-a068-bc01c7dbe072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:19 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Volume 88c7092f-a0c0-4780-a979-321b44150fa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88c7092f-a0c0-4780-a979-321b44150fa0', 'volume_size': 1} Jun 24 09:51:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:51:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:51:19 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=66542450-e849-44f7-aeec-5c2e6f7c81b4,created_at=2026-06-24T07:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1818677207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66542450-e849-44f7-aeec-5c2e6f7c81b4,host='devstack@QuobyteHD#QuobyteHD',id=88c7092f-a0c0-4780-a979-321b44150fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba582ad1da746978a8c0307f77d63aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:51:19Z,use_quota=True,user_id='4e0648451c844744ba1efc6a2c88b89f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0dc843ca-c9f8-4f5f-b1ff-7f51081e86da),volume_type_id=0dc843ca-c9f8-4f5f-b1ff-7f51081e86da)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:51:19 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Creating volume 88c7092f-a0c0-4780-a979-321b44150fa0 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:51:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:51:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:51:19 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:51:19 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:51:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:51:19 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:51:19 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:51:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:19 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0 1073741824 Jun 24 09:51:19 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:20 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0 1073741824" returned: 0 in 1.002s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:20 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0 Jun 24 09:51:20 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:21 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0" returned: 0 in 0.776s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:51:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:51:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1e455e-557c-4264-a068-bc01c7dbe072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88c7092f-a0c0-4780-a979-321b44150fa0', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2727d54-be6b-47b5-9435-479f406ecedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:21 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Volume volume-88c7092f-a0c0-4780-a979-321b44150fa0 (88c7092f-a0c0-4780-a979-321b44150fa0): created successfully Jun 24 09:51:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2727d54-be6b-47b5-9435-479f406ecedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Flow 'volume_create_manager' (744bbb61-3c00-42b3-8f8a-888d58f3dc6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:51:21 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-0539a426-cdc1-4975-baea-065b4b7366a0 tempest-GroupSnapshotsV319Test-31374041 None] Created volume successfully. Jun 24 09:51:22 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-10344b2a-7290-430b-9b0f-2ea03ab542e2 tempest-GroupSnapshotsV319Test-31374041 None] GroupSnapshot 70488b9d-8c40-44b8-b313-dbcc21189404: creating. Jun 24 09:51:22 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-10344b2a-7290-430b-9b0f-2ea03ab542e2 tempest-GroupSnapshotsV319Test-31374041 None] Group snapshot 70488b9d-8c40-44b8-b313-dbcc21189404: creating. {{(pid=93447) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 24 09:51:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-10344b2a-7290-430b-9b0f-2ea03ab542e2 tempest-GroupSnapshotsV319Test-31374041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:51:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-10344b2a-7290-430b-9b0f-2ea03ab542e2 tempest-GroupSnapshotsV319Test-31374041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:51:22 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-10344b2a-7290-430b-9b0f-2ea03ab542e2 tempest-GroupSnapshotsV319Test-31374041 None] Creating offline snapshot fa9572a1-ef08-4c15-ad9b-041be9844c0a of volume 88c7092f-a0c0-4780-a979-321b44150fa0 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 09:51:22 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dd16c1-75b4-4716-b28c-be00b4cd1276]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:51:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-10344b2a-7290-430b-9b0f-2ea03ab542e2 tempest-GroupSnapshotsV319Test-31374041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:22 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0 Jun 24 09:51:22 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:23 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-10344b2a-7290-430b-9b0f-2ea03ab542e2 tempest-GroupSnapshotsV319Test-31374041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0" returned: 0 in 0.875s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-10344b2a-7290-430b-9b0f-2ea03ab542e2 tempest-GroupSnapshotsV319Test-31374041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.fa9572a1-ef08-4c15-ad9b-041be9844c0a 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:23 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.fa9572a1-ef08-4c15-ad9b-041be9844c0a 1G Jun 24 09:51:23 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:24 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-10344b2a-7290-430b-9b0f-2ea03ab542e2 tempest-GroupSnapshotsV319Test-31374041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.fa9572a1-ef08-4c15-ad9b-041be9844c0a 1G" returned: 0 in 0.913s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-10344b2a-7290-430b-9b0f-2ea03ab542e2 tempest-GroupSnapshotsV319Test-31374041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c7092f-a0c0-4780-a979-321b44150fa0 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.fa9572a1-ef08-4c15-ad9b-041be9844c0a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:24 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c7092f-a0c0-4780-a979-321b44150fa0 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.fa9572a1-ef08-4c15-ad9b-041be9844c0a Jun 24 09:51:24 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:24 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-10344b2a-7290-430b-9b0f-2ea03ab542e2 tempest-GroupSnapshotsV319Test-31374041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88c7092f-a0c0-4780-a979-321b44150fa0 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.fa9572a1-ef08-4c15-ad9b-041be9844c0a" returned: 0 in 0.688s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:24 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-10344b2a-7290-430b-9b0f-2ea03ab542e2 tempest-GroupSnapshotsV319Test-31374041 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.fa9572a1-ef08-4c15-ad9b-041be9844c0a is being set with open permissions: ugo+rw: NotImplementedError Jun 24 09:51:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-10344b2a-7290-430b-9b0f-2ea03ab542e2 tempest-GroupSnapshotsV319Test-31374041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.fa9572a1-ef08-4c15-ad9b-041be9844c0a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:24 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.fa9572a1-ef08-4c15-ad9b-041be9844c0a Jun 24 09:51:24 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:24 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:51:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:51:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:51:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:51:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:51:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:51:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:25 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:51:25 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:25 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-10344b2a-7290-430b-9b0f-2ea03ab542e2 tempest-GroupSnapshotsV319Test-31374041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.fa9572a1-ef08-4c15-ad9b-041be9844c0a" returned: 0 in 0.899s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-10344b2a-7290-430b-9b0f-2ea03ab542e2 tempest-GroupSnapshotsV319Test-31374041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:25 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.info Jun 24 09:51:25 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:25 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:51:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Flow 'volume_create_manager' (d661a4a4-04c1-4750-ac66-4d826191a628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:51:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1bd8f1a-8910-4aea-bcf4-ce87df6fffab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1bd8f1a-8910-4aea-bcf4-ce87df6fffab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-396522641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ef48db-6ea4-494a-b476-18fd5422bcd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a27b62b396b41a589a5a43aa1f233dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:51:26Z,use_quota=True,user_id='88508a82decd45ee9c3da18b19633179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e528ce56-2554-467f-9db4-145873ad28fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e528ce56-2554-467f-9db4-145873ad28fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fadb4716-5f3b-4a49-91ad-ba6d9e990390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fadb4716-5f3b-4a49-91ad-ba6d9e990390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67ef48db-6ea4-494a-b476-18fd5422bcd2', 'volume_name': 'volume-67ef48db-6ea4-494a-b476-18fd5422bcd2', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a112036-40f4-4832-aff6-4ffe1c12872f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a112036-40f4-4832-aff6-4ffe1c12872f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79429c4d-c498-4b3d-80fd-c4cdb8bf6ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:25 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Volume 67ef48db-6ea4-494a-b476-18fd5422bcd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67ef48db-6ea4-494a-b476-18fd5422bcd2', 'volume_size': 1} Jun 24 09:51:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:51:25 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.980s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:51:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:51:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 8 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 09:51:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 09:51:26 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-10344b2a-7290-430b-9b0f-2ea03ab542e2 tempest-GroupSnapshotsV319Test-31374041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.info" returned: 0 in 0.860s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:26 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-10344b2a-7290-430b-9b0f-2ea03ab542e2 tempest-GroupSnapshotsV319Test-31374041 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.info is being set with open permissions: ugo+rw: NotImplementedError Jun 24 09:51:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-10344b2a-7290-430b-9b0f-2ea03ab542e2 tempest-GroupSnapshotsV319Test-31374041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:26 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.info Jun 24 09:51:26 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:27 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-10344b2a-7290-430b-9b0f-2ea03ab542e2 tempest-GroupSnapshotsV319Test-31374041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.info" returned: 0 in 0.728s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-10344b2a-7290-430b-9b0f-2ea03ab542e2 tempest-GroupSnapshotsV319Test-31374041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.077s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:51:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.443s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:51:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-396522641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ef48db-6ea4-494a-b476-18fd5422bcd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a27b62b396b41a589a5a43aa1f233dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:51:26Z,use_quota=True,user_id='88508a82decd45ee9c3da18b19633179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:51:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Creating volume 67ef48db-6ea4-494a-b476-18fd5422bcd2 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:51:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:51:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:51:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:51:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:51:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:51:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:51:27 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:51:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-67ef48db-6ea4-494a-b476-18fd5422bcd2 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:27 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-67ef48db-6ea4-494a-b476-18fd5422bcd2 1073741824 Jun 24 09:51:27 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:27 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-10344b2a-7290-430b-9b0f-2ea03ab542e2 tempest-GroupSnapshotsV319Test-31374041 None] group_snapshot 70488b9d-8c40-44b8-b313-dbcc21189404: created successfully Jun 24 09:51:28 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-e008ab65-2e5b-4a7f-adbb-8efa8337c0c7 tempest-GroupSnapshotsV319Test-31374041 None] group_snapshot 70488b9d-8c40-44b8-b313-dbcc21189404: deleting Jun 24 09:51:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e008ab65-2e5b-4a7f-adbb-8efa8337c0c7 tempest-GroupSnapshotsV319Test-31374041 None] group_snapshot 70488b9d-8c40-44b8-b313-dbcc21189404: deleting {{(pid=93447) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 24 09:51:28 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e008ab65-2e5b-4a7f-adbb-8efa8337c0c7 tempest-GroupSnapshotsV319Test-31374041 None] Acquiring lock "cinder-quobyte-88c7092f-a0c0-4780-a979-321b44150fa0" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:51:28 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e008ab65-2e5b-4a7f-adbb-8efa8337c0c7 tempest-GroupSnapshotsV319Test-31374041 None] Lock "cinder-quobyte-88c7092f-a0c0-4780-a979-321b44150fa0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:51:28 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e008ab65-2e5b-4a7f-adbb-8efa8337c0c7 tempest-GroupSnapshotsV319Test-31374041 None] Acquiring lock "cinder-quobyte-fa9572a1-ef08-4c15-ad9b-041be9844c0a" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:51:28 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e008ab65-2e5b-4a7f-adbb-8efa8337c0c7 tempest-GroupSnapshotsV319Test-31374041 None] Lock "cinder-quobyte-fa9572a1-ef08-4c15-ad9b-041be9844c0a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:51:28 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-e008ab65-2e5b-4a7f-adbb-8efa8337c0c7 tempest-GroupSnapshotsV319Test-31374041 None] Deleting offline snapshot fa9572a1-ef08-4c15-ad9b-041be9844c0a of volume 88c7092f-a0c0-4780-a979-321b44150fa0 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 09:51:28 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-e008ab65-2e5b-4a7f-adbb-8efa8337c0c7 tempest-GroupSnapshotsV319Test-31374041 None] snapshot_file for this snap is: volume-88c7092f-a0c0-4780-a979-321b44150fa0.fa9572a1-ef08-4c15-ad9b-041be9844c0a {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 09:51:28 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f168c0b5-bca5-4d39-a334-d027b91b78ef]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:51:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e008ab65-2e5b-4a7f-adbb-8efa8337c0c7 tempest-GroupSnapshotsV319Test-31374041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.fa9572a1-ef08-4c15-ad9b-041be9844c0a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:28 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-67ef48db-6ea4-494a-b476-18fd5422bcd2 1073741824" returned: 0 in 1.133s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:28 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.fa9572a1-ef08-4c15-ad9b-041be9844c0a Jun 24 09:51:28 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-67ef48db-6ea4-494a-b476-18fd5422bcd2 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:28 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-67ef48db-6ea4-494a-b476-18fd5422bcd2 Jun 24 09:51:28 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:29 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-67ef48db-6ea4-494a-b476-18fd5422bcd2" returned: 0 in 0.793s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:29 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] <== create_volume: return (1994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:51:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.998s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:51:29 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e008ab65-2e5b-4a7f-adbb-8efa8337c0c7 tempest-GroupSnapshotsV319Test-31374041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.fa9572a1-ef08-4c15-ad9b-041be9844c0a" returned: 0 in 0.979s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:29 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-e008ab65-2e5b-4a7f-adbb-8efa8337c0c7 tempest-GroupSnapshotsV319Test-31374041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88c7092f-a0c0-4780-a979-321b44150fa0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:51:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79429c4d-c498-4b3d-80fd-c4cdb8bf6ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67ef48db-6ea4-494a-b476-18fd5422bcd2', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f93330f-d32d-44e0-b841-453d0ba3a0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:29 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa68032-7732-4d06-b3fa-c016e98de63c]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:51:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e008ab65-2e5b-4a7f-adbb-8efa8337c0c7 tempest-GroupSnapshotsV319Test-31374041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:29 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Volume volume-67ef48db-6ea4-494a-b476-18fd5422bcd2 (67ef48db-6ea4-494a-b476-18fd5422bcd2): created successfully Jun 24 09:51:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f93330f-d32d-44e0-b841-453d0ba3a0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Flow 'volume_create_manager' (d661a4a4-04c1-4750-ac66-4d826191a628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:51:29 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-cf7ca54c-12b8-454b-929e-203819d987b2 tempest-AttachVolumeTestJSON-524336646 None] Created volume successfully. Jun 24 09:51:29 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0 Jun 24 09:51:29 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:30 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e008ab65-2e5b-4a7f-adbb-8efa8337c0c7 tempest-GroupSnapshotsV319Test-31374041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0" returned: 0 in 0.897s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e008ab65-2e5b-4a7f-adbb-8efa8337c0c7 tempest-GroupSnapshotsV319Test-31374041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.fa9572a1-ef08-4c15-ad9b-041be9844c0a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:30 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.fa9572a1-ef08-4c15-ad9b-041be9844c0a Jun 24 09:51:30 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:31 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e008ab65-2e5b-4a7f-adbb-8efa8337c0c7 tempest-GroupSnapshotsV319Test-31374041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.fa9572a1-ef08-4c15-ad9b-041be9844c0a" returned: 0 in 0.840s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e008ab65-2e5b-4a7f-adbb-8efa8337c0c7 tempest-GroupSnapshotsV319Test-31374041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.fa9572a1-ef08-4c15-ad9b-041be9844c0a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:31 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.fa9572a1-ef08-4c15-ad9b-041be9844c0a Jun 24 09:51:31 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:31 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e008ab65-2e5b-4a7f-adbb-8efa8337c0c7 tempest-GroupSnapshotsV319Test-31374041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0.fa9572a1-ef08-4c15-ad9b-041be9844c0a" returned: 0 in 0.716s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e008ab65-2e5b-4a7f-adbb-8efa8337c0c7 tempest-GroupSnapshotsV319Test-31374041 None] Lock "cinder-quobyte-fa9572a1-ef08-4c15-ad9b-041be9844c0a" released by "_delete_snapshot" :: held 3.558s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:51:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e008ab65-2e5b-4a7f-adbb-8efa8337c0c7 tempest-GroupSnapshotsV319Test-31374041 None] Lock "cinder-quobyte-88c7092f-a0c0-4780-a979-321b44150fa0" released by "delete_snapshot" :: held 3.586s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:51:31 devstack cinder-volume[93447]: WARNING cinder.quota [None req-e008ab65-2e5b-4a7f-adbb-8efa8337c0c7 tempest-GroupSnapshotsV319Test-31374041 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1501230306 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1501230306, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:51:31 devstack cinder-volume[93447]: WARNING cinder.quota [None req-e008ab65-2e5b-4a7f-adbb-8efa8337c0c7 tempest-GroupSnapshotsV319Test-31374041 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1501230306 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1501230306, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:51:31 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-e008ab65-2e5b-4a7f-adbb-8efa8337c0c7 tempest-GroupSnapshotsV319Test-31374041 None] Created reservations ['29fcf31b-0221-4da3-a067-3e4274f95710', '54e3c347-fb11-40da-a7b5-64890f80b641', 'fedd84ed-06b1-4260-a99b-4cebb1de8ba2', 'e5599f7c-1094-478e-ac6a-b7fef5471fdb'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:51:32 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-e008ab65-2e5b-4a7f-adbb-8efa8337c0c7 tempest-GroupSnapshotsV319Test-31374041 None] group_snapshot 70488b9d-8c40-44b8-b313-dbcc21189404: deleted successfully Jun 24 09:51:33 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ba3f5d09-cff3-4ca7-90b0-3a10b4fb44cd tempest-GroupSnapshotsV319Test-31374041 None] Acquiring lock "cinder-quobyte-88c7092f-a0c0-4780-a979-321b44150fa0" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:51:33 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ba3f5d09-cff3-4ca7-90b0-3a10b4fb44cd tempest-GroupSnapshotsV319Test-31374041 None] Lock "cinder-quobyte-88c7092f-a0c0-4780-a979-321b44150fa0" acquired by "delete_volume" :: waited 0.024s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:51:33 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb77d16b-814f-463d-8fec-1444cd697462]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:51:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ba3f5d09-cff3-4ca7-90b0-3a10b4fb44cd tempest-GroupSnapshotsV319Test-31374041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-dc50d577-e34f-458e-8bbe-4667c6fa9a27 req-3fbadade-c4c2-4026-bfae-77cba73ded02 tempest-AttachVolumeTestJSON-524336646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:51:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-dc50d577-e34f-458e-8bbe-4667c6fa9a27 req-3fbadade-c4c2-4026-bfae-77cba73ded02 tempest-AttachVolumeTestJSON-524336646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:51:33 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[481e5442-8dcb-40f3-8636-1d93973b5fe8]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:51:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-dc50d577-e34f-458e-8bbe-4667c6fa9a27 req-3fbadade-c4c2-4026-bfae-77cba73ded02 tempest-AttachVolumeTestJSON-524336646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-67ef48db-6ea4-494a-b476-18fd5422bcd2 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:33 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0 Jun 24 09:51:33 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:33 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-67ef48db-6ea4-494a-b476-18fd5422bcd2 Jun 24 09:51:33 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:34 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:34 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-dc50d577-e34f-458e-8bbe-4667c6fa9a27 req-3fbadade-c4c2-4026-bfae-77cba73ded02 tempest-AttachVolumeTestJSON-524336646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-67ef48db-6ea4-494a-b476-18fd5422bcd2" returned: 0 in 0.933s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-dc50d577-e34f-458e-8bbe-4667c6fa9a27 req-3fbadade-c4c2-4026-bfae-77cba73ded02 tempest-AttachVolumeTestJSON-524336646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.958s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:51:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ba3f5d09-cff3-4ca7-90b0-3a10b4fb44cd tempest-GroupSnapshotsV319Test-31374041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0" returned: 0 in 1.017s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ba3f5d09-cff3-4ca7-90b0-3a10b4fb44cd tempest-GroupSnapshotsV319Test-31374041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:34 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0 Jun 24 09:51:34 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-dc50d577-e34f-458e-8bbe-4667c6fa9a27 req-3fbadade-c4c2-4026-bfae-77cba73ded02 tempest-AttachVolumeTestJSON-524336646 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb', 'name': 'volume-67ef48db-6ea4-494a-b476-18fd5422bcd2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3deff444-42d1-4396-b7e1-d1d816a028b4', 'enforce_multipath': True} {{(pid=93447) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 09:51:34 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-dc50d577-e34f-458e-8bbe-4667c6fa9a27 req-3fbadade-c4c2-4026-bfae-77cba73ded02 tempest-AttachVolumeTestJSON-524336646 None] attachment_update completed successfully. Jun 24 09:51:34 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ba3f5d09-cff3-4ca7-90b0-3a10b4fb44cd tempest-GroupSnapshotsV319Test-31374041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-88c7092f-a0c0-4780-a979-321b44150fa0" returned: 0 in 0.725s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:34 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ba3f5d09-cff3-4ca7-90b0-3a10b4fb44cd tempest-GroupSnapshotsV319Test-31374041 None] Lock "cinder-quobyte-88c7092f-a0c0-4780-a979-321b44150fa0" released by "delete_volume" :: held 1.837s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:51:35 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-ba3f5d09-cff3-4ca7-90b0-3a10b4fb44cd tempest-GroupSnapshotsV319Test-31374041 None] Created reservations ['1c19f17a-4dd7-4373-932b-7ae1d507b18d'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:51:35 devstack cinder-volume[93447]: WARNING cinder.quota [None req-ba3f5d09-cff3-4ca7-90b0-3a10b4fb44cd tempest-GroupSnapshotsV319Test-31374041 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1501230306 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1501230306, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:51:35 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-ba3f5d09-cff3-4ca7-90b0-3a10b4fb44cd tempest-GroupSnapshotsV319Test-31374041 None] Created reservations ['7e93de44-ef6a-47ea-81f9-c608fab5da85', '4dae0034-4e64-47a8-90d9-2af31bff882c', 'fb3ce9a9-454c-41cb-9365-4cac4f61675d', '04e2cf14-6676-4f77-bd3c-4ac04ff18504'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:51:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ba3f5d09-cff3-4ca7-90b0-3a10b4fb44cd tempest-GroupSnapshotsV319Test-31374041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:51:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ba3f5d09-cff3-4ca7-90b0-3a10b4fb44cd tempest-GroupSnapshotsV319Test-31374041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:51:35 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ba3f5d09-cff3-4ca7-90b0-3a10b4fb44cd tempest-GroupSnapshotsV319Test-31374041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:51:35 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ba3f5d09-cff3-4ca7-90b0-3a10b4fb44cd tempest-GroupSnapshotsV319Test-31374041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:51:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ba3f5d09-cff3-4ca7-90b0-3a10b4fb44cd tempest-GroupSnapshotsV319Test-31374041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:51:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ba3f5d09-cff3-4ca7-90b0-3a10b4fb44cd tempest-GroupSnapshotsV319Test-31374041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:35 devstack sudo[100860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:51:35 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:36 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ba3f5d09-cff3-4ca7-90b0-3a10b4fb44cd tempest-GroupSnapshotsV319Test-31374041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.290s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:36 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-ba3f5d09-cff3-4ca7-90b0-3a10b4fb44cd tempest-GroupSnapshotsV319Test-31374041 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:51:36 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-ba3f5d09-cff3-4ca7-90b0-3a10b4fb44cd tempest-GroupSnapshotsV319Test-31374041 None] Delete group completed successfully. Jun 24 09:51:40 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:51:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Flow 'volume_create_manager' (d5ebea5a-5b47-4ad2-83ff-e683426194f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:51:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc83d0ce-6688-4891-9bf3-d21e552f83c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc83d0ce-6688-4891-9bf3-d21e552f83c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-200232299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e9cdb7-e623-42e6-927a-9963b95491f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2027a78a6f646588b88e19c8683043d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:51:40Z,use_quota=True,user_id='525634a2142c40bebed1b9095733b30f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(221fabe4-fe97-4218-b50d-d5ee30efc3d5),volume_type_id=221fabe4-fe97-4218-b50d-d5ee30efc3d5)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409b3752-48da-48a8-8779-20d867d81dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409b3752-48da-48a8-8779-20d867d81dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7340a2ba-7e98-48bf-b4b8-d693e53c411d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7340a2ba-7e98-48bf-b4b8-d693e53c411d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47e9cdb7-e623-42e6-927a-9963b95491f6', 'volume_name': 'volume-47e9cdb7-e623-42e6-927a-9963b95491f6', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c5cc05f-29d6-40e1-8665-5caca1e62e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c5cc05f-29d6-40e1-8665-5caca1e62e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7bbfa4-5bc3-407c-8f8d-f17594dcf1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:40 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Volume 47e9cdb7-e623-42e6-927a-9963b95491f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47e9cdb7-e623-42e6-927a-9963b95491f6', 'volume_size': 1} Jun 24 09:51:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:51:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:51:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-200232299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e9cdb7-e623-42e6-927a-9963b95491f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2027a78a6f646588b88e19c8683043d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:51:40Z,use_quota=True,user_id='525634a2142c40bebed1b9095733b30f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(221fabe4-fe97-4218-b50d-d5ee30efc3d5),volume_type_id=221fabe4-fe97-4218-b50d-d5ee30efc3d5)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:51:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Creating volume 47e9cdb7-e623-42e6-927a-9963b95491f6 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:51:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:51:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:51:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:51:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:51:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:51:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:51:40 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:51:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47e9cdb7-e623-42e6-927a-9963b95491f6 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:40 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47e9cdb7-e623-42e6-927a-9963b95491f6 1073741824 Jun 24 09:51:40 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:41 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47e9cdb7-e623-42e6-927a-9963b95491f6 1073741824" returned: 0 in 0.890s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47e9cdb7-e623-42e6-927a-9963b95491f6 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:41 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47e9cdb7-e623-42e6-927a-9963b95491f6 Jun 24 09:51:41 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:42 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47e9cdb7-e623-42e6-927a-9963b95491f6" returned: 0 in 0.942s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7bbfa4-5bc3-407c-8f8d-f17594dcf1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47e9cdb7-e623-42e6-927a-9963b95491f6', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bfda30c-6bc9-401f-b16a-8c2ebe0f0d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:42 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Volume volume-47e9cdb7-e623-42e6-927a-9963b95491f6 (47e9cdb7-e623-42e6-927a-9963b95491f6): created successfully Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bfda30c-6bc9-401f-b16a-8c2ebe0f0d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Flow 'volume_create_manager' (d5ebea5a-5b47-4ad2-83ff-e683426194f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:51:42 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-9feccd8f-4a90-48a4-beaf-39e738ffe37d tempest-VolumeTypesAccessTest-1476028156 None] Created volume successfully. Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Flow 'volume_create_manager' (b962e6b8-908b-4344-9372-9ad803692fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492a2941-cd3a-418e-9103-ff852adfeb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492a2941-cd3a-418e-9103-ff852adfeb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-434671826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e39960d9-67c6-4a8c-b81d-3ee0f5fcd585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d57d6a8221594c72bfa54e081c83b7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:51:43Z,use_quota=True,user_id='f45a1ef079e84bc68cebeaa3d491d34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9b153e-710e-4733-bcda-3c6fa3a57106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9b153e-710e-4733-bcda-3c6fa3a57106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1441fc7-cb8f-401e-9aff-04a70ca065b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1441fc7-cb8f-401e-9aff-04a70ca065b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e39960d9-67c6-4a8c-b81d-3ee0f5fcd585', 'volume_name': 'volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e45b55-e06c-48a0-8e5e-b81441ecb6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e45b55-e06c-48a0-8e5e-b81441ecb6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892f7a5b-a224-44c4-a353-a7d3aaa7f63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:42 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Volume e39960d9-67c6-4a8c-b81d-3ee0f5fcd585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585', 'volume_size': 1} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-434671826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e39960d9-67c6-4a8c-b81d-3ee0f5fcd585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d57d6a8221594c72bfa54e081c83b7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:51:43Z,use_quota=True,user_id='f45a1ef079e84bc68cebeaa3d491d34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Creating volume e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:51:42 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:51:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:42 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 1073741824 Jun 24 09:51:42 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3c82bbb7-f1fa-42ee-ba06-ebd4d9fd8b79 tempest-VolumeTypesAccessTest-1476028156 None] Acquiring lock "cinder-47e9cdb7-e623-42e6-927a-9963b95491f6-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:51:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3c82bbb7-f1fa-42ee-ba06-ebd4d9fd8b79 tempest-VolumeTypesAccessTest-1476028156 None] Lock "cinder-47e9cdb7-e623-42e6-927a-9963b95491f6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:51:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3c82bbb7-f1fa-42ee-ba06-ebd4d9fd8b79 tempest-VolumeTypesAccessTest-1476028156 None] Acquiring lock "cinder-quobyte-47e9cdb7-e623-42e6-927a-9963b95491f6" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:51:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3c82bbb7-f1fa-42ee-ba06-ebd4d9fd8b79 tempest-VolumeTypesAccessTest-1476028156 None] Lock "cinder-quobyte-47e9cdb7-e623-42e6-927a-9963b95491f6" acquired by "delete_volume" :: waited 0.027s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:51:43 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fc4810-b5fe-48bf-baff-440b681c0910]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:51:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3c82bbb7-f1fa-42ee-ba06-ebd4d9fd8b79 tempest-VolumeTypesAccessTest-1476028156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47e9cdb7-e623-42e6-927a-9963b95491f6 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:43 devstack sudo[101289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47e9cdb7-e623-42e6-927a-9963b95491f6 Jun 24 09:51:43 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:43 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 1073741824" returned: 0 in 1.122s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:44 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 Jun 24 09:51:44 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:44 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3c82bbb7-f1fa-42ee-ba06-ebd4d9fd8b79 tempest-VolumeTypesAccessTest-1476028156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47e9cdb7-e623-42e6-927a-9963b95491f6" returned: 0 in 1.332s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3c82bbb7-f1fa-42ee-ba06-ebd4d9fd8b79 tempest-VolumeTypesAccessTest-1476028156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47e9cdb7-e623-42e6-927a-9963b95491f6 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:44 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47e9cdb7-e623-42e6-927a-9963b95491f6 Jun 24 09:51:44 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:45 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585" returned: 0 in 1.170s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:45 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] <== create_volume: return (2402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:51:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.404s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:51:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (892f7a5b-a224-44c4-a353-a7d3aaa7f63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3233e532-2b43-431d-838b-d94ad285beb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:51:45 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Volume volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 (e39960d9-67c6-4a8c-b81d-3ee0f5fcd585): created successfully Jun 24 09:51:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3233e532-2b43-431d-838b-d94ad285beb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:51:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Flow 'volume_create_manager' (b962e6b8-908b-4344-9372-9ad803692fa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:51:45 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-ec02d755-262c-45be-8507-00aae4b8840c tempest-SnapshotsActionsTest-1225648455 None] Created volume successfully. Jun 24 09:51:45 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3c82bbb7-f1fa-42ee-ba06-ebd4d9fd8b79 tempest-VolumeTypesAccessTest-1476028156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47e9cdb7-e623-42e6-927a-9963b95491f6" returned: 0 in 0.842s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3c82bbb7-f1fa-42ee-ba06-ebd4d9fd8b79 tempest-VolumeTypesAccessTest-1476028156 None] Lock "cinder-quobyte-47e9cdb7-e623-42e6-927a-9963b95491f6" released by "delete_volume" :: held 2.254s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:51:45 devstack cinder-volume[93447]: WARNING cinder.quota [None req-3c82bbb7-f1fa-42ee-ba06-ebd4d9fd8b79 tempest-VolumeTypesAccessTest-1476028156 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1429195389 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1429195389, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:51:45 devstack cinder-volume[93447]: WARNING cinder.quota [None req-3c82bbb7-f1fa-42ee-ba06-ebd4d9fd8b79 tempest-VolumeTypesAccessTest-1476028156 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1429195389 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1429195389, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:51:45 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-3c82bbb7-f1fa-42ee-ba06-ebd4d9fd8b79 tempest-VolumeTypesAccessTest-1476028156 None] Created reservations ['d10c0a95-2350-4e17-9b00-5606eb3d7c05', '3337a8fb-1ad0-4bcc-85d6-57c27e84fdc6', 'fe79619a-a955-459b-a076-acb37847ee2d', '8a5c9aca-f5eb-41b2-ac7c-43d2d2854317'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:51:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3c82bbb7-f1fa-42ee-ba06-ebd4d9fd8b79 tempest-VolumeTypesAccessTest-1476028156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:51:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3c82bbb7-f1fa-42ee-ba06-ebd4d9fd8b79 tempest-VolumeTypesAccessTest-1476028156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:51:45 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3c82bbb7-f1fa-42ee-ba06-ebd4d9fd8b79 tempest-VolumeTypesAccessTest-1476028156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:51:45 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3c82bbb7-f1fa-42ee-ba06-ebd4d9fd8b79 tempest-VolumeTypesAccessTest-1476028156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:51:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3c82bbb7-f1fa-42ee-ba06-ebd4d9fd8b79 tempest-VolumeTypesAccessTest-1476028156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:51:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3c82bbb7-f1fa-42ee-ba06-ebd4d9fd8b79 tempest-VolumeTypesAccessTest-1476028156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:45 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:51:45 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-adb530e7-d8c7-4ae5-b587-73fb68168e4c tempest-SnapshotsActionsTest-1225648455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:51:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-adb530e7-d8c7-4ae5-b587-73fb68168e4c tempest-SnapshotsActionsTest-1225648455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:51:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-adb530e7-d8c7-4ae5-b587-73fb68168e4c tempest-SnapshotsActionsTest-1225648455 None] Creating offline snapshot 68a05b99-e069-4f94-bbc1-4097278f9972 of volume e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 09:51:46 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e45406-5202-47a8-8704-e9871be51fa3]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:51:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-adb530e7-d8c7-4ae5-b587-73fb68168e4c tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:46 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 Jun 24 09:51:46 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:46 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3c82bbb7-f1fa-42ee-ba06-ebd4d9fd8b79 tempest-VolumeTypesAccessTest-1476028156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.741s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:46 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-3c82bbb7-f1fa-42ee-ba06-ebd4d9fd8b79 tempest-VolumeTypesAccessTest-1476028156 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:51:46 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-3c82bbb7-f1fa-42ee-ba06-ebd4d9fd8b79 tempest-VolumeTypesAccessTest-1476028156 None] Deleted volume successfully. Jun 24 09:51:46 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3c82bbb7-f1fa-42ee-ba06-ebd4d9fd8b79 tempest-VolumeTypesAccessTest-1476028156 None] Lock "cinder-47e9cdb7-e623-42e6-927a-9963b95491f6-delete_volume" released by "delete_volume" :: held 3.250s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:51:47 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-adb530e7-d8c7-4ae5-b587-73fb68168e4c tempest-SnapshotsActionsTest-1225648455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585" returned: 0 in 1.085s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-adb530e7-d8c7-4ae5-b587-73fb68168e4c tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:47 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 1G Jun 24 09:51:47 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:48 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-adb530e7-d8c7-4ae5-b587-73fb68168e4c tempest-SnapshotsActionsTest-1225648455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 1G" returned: 0 in 1.329s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-adb530e7-d8c7-4ae5-b587-73fb68168e4c tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:48 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 Jun 24 09:51:48 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:49 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-adb530e7-d8c7-4ae5-b587-73fb68168e4c tempest-SnapshotsActionsTest-1225648455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972" returned: 0 in 0.993s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:49 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-adb530e7-d8c7-4ae5-b587-73fb68168e4c tempest-SnapshotsActionsTest-1225648455 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 is being set with open permissions: ugo+rw Jun 24 09:51:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-adb530e7-d8c7-4ae5-b587-73fb68168e4c tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:49 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 Jun 24 09:51:49 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:50 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-adb530e7-d8c7-4ae5-b587-73fb68168e4c tempest-SnapshotsActionsTest-1225648455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972" returned: 0 in 1.002s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-adb530e7-d8c7-4ae5-b587-73fb68168e4c tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:50 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.info Jun 24 09:51:50 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:51 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-adb530e7-d8c7-4ae5-b587-73fb68168e4c tempest-SnapshotsActionsTest-1225648455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.info" returned: 0 in 0.916s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:51 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-adb530e7-d8c7-4ae5-b587-73fb68168e4c tempest-SnapshotsActionsTest-1225648455 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.info is being set with open permissions: ugo+rw Jun 24 09:51:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-adb530e7-d8c7-4ae5-b587-73fb68168e4c tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:51 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.info Jun 24 09:51:51 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:52 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-adb530e7-d8c7-4ae5-b587-73fb68168e4c tempest-SnapshotsActionsTest-1225648455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.info" returned: 0 in 0.850s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-adb530e7-d8c7-4ae5-b587-73fb68168e4c tempest-SnapshotsActionsTest-1225648455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.284s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:51:52 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-adb530e7-d8c7-4ae5-b587-73fb68168e4c tempest-SnapshotsActionsTest-1225648455 None] Create snapshot completed successfully Jun 24 09:51:55 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:UPDATE=71,cinder:SELECT=77,cinder:INSERT=13,cinder:DELETE=2 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:51:55 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:UPDATE=94,cinder:SELECT=76,cinder:DELETE=7,cinder:INSERT=22 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:51:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d3b0297c-a4c2-4a09-99e0-085aed43380e tempest-SnapshotsActionsTest-1225648455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:51:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d3b0297c-a4c2-4a09-99e0-085aed43380e tempest-SnapshotsActionsTest-1225648455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:51:56 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-d3b0297c-a4c2-4a09-99e0-085aed43380e tempest-SnapshotsActionsTest-1225648455 None] Creating offline snapshot 0b0435bd-72f8-465f-8a9a-59508292af18 of volume e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 09:51:56 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d36bae8-dde5-4805-8a63-63a9a0332104]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:51:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d3b0297c-a4c2-4a09-99e0-085aed43380e tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:56 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 Jun 24 09:51:56 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:57 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d3b0297c-a4c2-4a09-99e0-085aed43380e tempest-SnapshotsActionsTest-1225648455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972" returned: 0 in 0.941s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:57 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-d3b0297c-a4c2-4a09-99e0-085aed43380e tempest-SnapshotsActionsTest-1225648455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:51:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d3b0297c-a4c2-4a09-99e0-085aed43380e tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.0b0435bd-72f8-465f-8a9a-59508292af18 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:57 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.0b0435bd-72f8-465f-8a9a-59508292af18 1G Jun 24 09:51:57 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:58 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d3b0297c-a4c2-4a09-99e0-085aed43380e tempest-SnapshotsActionsTest-1225648455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.0b0435bd-72f8-465f-8a9a-59508292af18 1G" returned: 0 in 1.082s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d3b0297c-a4c2-4a09-99e0-085aed43380e tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.0b0435bd-72f8-465f-8a9a-59508292af18 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:58 devstack sudo[101949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.0b0435bd-72f8-465f-8a9a-59508292af18 Jun 24 09:51:58 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:59 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d3b0297c-a4c2-4a09-99e0-085aed43380e tempest-SnapshotsActionsTest-1225648455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.0b0435bd-72f8-465f-8a9a-59508292af18" returned: 0 in 0.803s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:59 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-d3b0297c-a4c2-4a09-99e0-085aed43380e tempest-SnapshotsActionsTest-1225648455 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.0b0435bd-72f8-465f-8a9a-59508292af18 is being set with open permissions: ugo+rw Jun 24 09:51:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d3b0297c-a4c2-4a09-99e0-085aed43380e tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.0b0435bd-72f8-465f-8a9a-59508292af18 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:51:59 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.0b0435bd-72f8-465f-8a9a-59508292af18 Jun 24 09:51:59 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:51:59 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Jun 24 09:51:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d3b0297c-a4c2-4a09-99e0-085aed43380e tempest-SnapshotsActionsTest-1225648455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.0b0435bd-72f8-465f-8a9a-59508292af18" returned: 0 in 0.660s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:51:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d3b0297c-a4c2-4a09-99e0-085aed43380e tempest-SnapshotsActionsTest-1225648455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.712s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:51:59 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-d3b0297c-a4c2-4a09-99e0-085aed43380e tempest-SnapshotsActionsTest-1225648455 None] Create snapshot completed successfully Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Flow 'volume_create_manager' (b0154d25-da4d-4f32-92a9-f999b20f5ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5c4c1cd-0c84-4e48-bab2-f07438c8b4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5c4c1cd-0c84-4e48-bab2-f07438c8b4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-870374614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e0a7ce-aa59-4ec6-911e-a221dc35c430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dffbdc4ba5f4aa29745369df3301428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:52:00Z,use_quota=True,user_id='d5019707bfd04767a29ca6a262757a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a5cddf-a121-4a64-b4b8-6f462c7fce83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a5cddf-a121-4a64-b4b8-6f462c7fce83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71594d76-61f8-455e-b767-e21ae072c83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71594d76-61f8-455e-b767-e21ae072c83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32e0a7ce-aa59-4ec6-911e-a221dc35c430', 'volume_name': 'volume-32e0a7ce-aa59-4ec6-911e-a221dc35c430', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f892df-08a6-41f0-ac99-f406133927fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f892df-08a6-41f0-ac99-f406133927fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c1176c-6bf6-47c5-a229-75fdb970b2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:00 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Volume 32e0a7ce-aa59-4ec6-911e-a221dc35c430: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32e0a7ce-aa59-4ec6-911e-a221dc35c430', 'volume_size': 1} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-870374614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e0a7ce-aa59-4ec6-911e-a221dc35c430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dffbdc4ba5f4aa29745369df3301428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:52:00Z,use_quota=True,user_id='d5019707bfd04767a29ca6a262757a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Creating volume 32e0a7ce-aa59-4ec6-911e-a221dc35c430 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:52:00 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-32e0a7ce-aa59-4ec6-911e-a221dc35c430 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:00 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-32e0a7ce-aa59-4ec6-911e-a221dc35c430 1073741824 Jun 24 09:52:00 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-eaf75400-a967-4992-a473-ebf19f957314 tempest-SnapshotsActionsTest-1820002773 None] Acquiring lock "cinder-0b0435bd-72f8-465f-8a9a-59508292af18-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-eaf75400-a967-4992-a473-ebf19f957314 tempest-SnapshotsActionsTest-1820002773 None] Lock "cinder-0b0435bd-72f8-465f-8a9a-59508292af18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-eaf75400-a967-4992-a473-ebf19f957314 tempest-SnapshotsActionsTest-1820002773 None] Acquiring lock "cinder-quobyte-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-eaf75400-a967-4992-a473-ebf19f957314 tempest-SnapshotsActionsTest-1820002773 None] Lock "cinder-quobyte-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-eaf75400-a967-4992-a473-ebf19f957314 tempest-SnapshotsActionsTest-1820002773 None] Acquiring lock "cinder-quobyte-0b0435bd-72f8-465f-8a9a-59508292af18" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-eaf75400-a967-4992-a473-ebf19f957314 tempest-SnapshotsActionsTest-1820002773 None] Lock "cinder-quobyte-0b0435bd-72f8-465f-8a9a-59508292af18" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-eaf75400-a967-4992-a473-ebf19f957314 tempest-SnapshotsActionsTest-1820002773 None] Deleting offline snapshot 0b0435bd-72f8-465f-8a9a-59508292af18 of volume e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-eaf75400-a967-4992-a473-ebf19f957314 tempest-SnapshotsActionsTest-1820002773 None] snapshot_file for this snap is: volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.0b0435bd-72f8-465f-8a9a-59508292af18 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f595ede1-91ac-42d3-a686-8a19ff7c0920]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-eaf75400-a967-4992-a473-ebf19f957314 tempest-SnapshotsActionsTest-1820002773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.0b0435bd-72f8-465f-8a9a-59508292af18 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:00 devstack sudo[101985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.0b0435bd-72f8-465f-8a9a-59508292af18 Jun 24 09:52:00 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:01 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-32e0a7ce-aa59-4ec6-911e-a221dc35c430 1073741824" returned: 0 in 0.903s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-32e0a7ce-aa59-4ec6-911e-a221dc35c430 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:01 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-32e0a7ce-aa59-4ec6-911e-a221dc35c430 Jun 24 09:52:01 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:01 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-eaf75400-a967-4992-a473-ebf19f957314 tempest-SnapshotsActionsTest-1820002773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.0b0435bd-72f8-465f-8a9a-59508292af18" returned: 0 in 0.818s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:01 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-eaf75400-a967-4992-a473-ebf19f957314 tempest-SnapshotsActionsTest-1820002773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:52:01 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca462c47-2229-4f25-8cab-89a7d8c49b9d]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-eaf75400-a967-4992-a473-ebf19f957314 tempest-SnapshotsActionsTest-1820002773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:01 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 Jun 24 09:52:01 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:01 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-32e0a7ce-aa59-4ec6-911e-a221dc35c430" returned: 0 in 0.666s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:01 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:52:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:01 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c1176c-6bf6-47c5-a229-75fdb970b2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32e0a7ce-aa59-4ec6-911e-a221dc35c430', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:01 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (259edd95-aef4-4b3e-bcf9-a530194edb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:01 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Volume volume-32e0a7ce-aa59-4ec6-911e-a221dc35c430 (32e0a7ce-aa59-4ec6-911e-a221dc35c430): created successfully Jun 24 09:52:01 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (259edd95-aef4-4b3e-bcf9-a530194edb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:01 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Flow 'volume_create_manager' (b0154d25-da4d-4f32-92a9-f999b20f5ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:52:01 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-7d86fa2a-5f6d-4510-a9be-a9a993f29125 tempest-VolumesListAdminTestJSON-2114967 None] Created volume successfully. Jun 24 09:52:02 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-eaf75400-a967-4992-a473-ebf19f957314 tempest-SnapshotsActionsTest-1820002773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972" returned: 0 in 0.798s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:02 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-eaf75400-a967-4992-a473-ebf19f957314 tempest-SnapshotsActionsTest-1820002773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:52:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-eaf75400-a967-4992-a473-ebf19f957314 tempest-SnapshotsActionsTest-1820002773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.0b0435bd-72f8-465f-8a9a-59508292af18 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:02 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.0b0435bd-72f8-465f-8a9a-59508292af18 Jun 24 09:52:02 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:02 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-eaf75400-a967-4992-a473-ebf19f957314 tempest-SnapshotsActionsTest-1820002773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.0b0435bd-72f8-465f-8a9a-59508292af18" returned: 0 in 0.759s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-eaf75400-a967-4992-a473-ebf19f957314 tempest-SnapshotsActionsTest-1820002773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.0b0435bd-72f8-465f-8a9a-59508292af18 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:02 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.0b0435bd-72f8-465f-8a9a-59508292af18 Jun 24 09:52:02 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:03 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-eaf75400-a967-4992-a473-ebf19f957314 tempest-SnapshotsActionsTest-1820002773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.0b0435bd-72f8-465f-8a9a-59508292af18" returned: 0 in 0.679s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-eaf75400-a967-4992-a473-ebf19f957314 tempest-SnapshotsActionsTest-1820002773 None] Lock "cinder-quobyte-0b0435bd-72f8-465f-8a9a-59508292af18" released by "_delete_snapshot" :: held 3.169s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-eaf75400-a967-4992-a473-ebf19f957314 tempest-SnapshotsActionsTest-1820002773 None] Lock "cinder-quobyte-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585" released by "delete_snapshot" :: held 3.195s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Flow 'volume_create_manager' (6fb3142c-c8b4-4489-8e0c-0b2e0e57db58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9efa13d-9fe1-457b-bfb6-e5e1117107d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9efa13d-9fe1-457b-bfb6-e5e1117107d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1011475741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=673dcd55-d7f3-46d4-bef8-11f954e8743b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dffbdc4ba5f4aa29745369df3301428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:52:04Z,use_quota=True,user_id='d5019707bfd04767a29ca6a262757a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b076b3d2-bc21-4950-bd60-3d617ab55679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b076b3d2-bc21-4950-bd60-3d617ab55679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb693d9-32dc-47a6-83d5-0eb5327f84de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb693d9-32dc-47a6-83d5-0eb5327f84de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '673dcd55-d7f3-46d4-bef8-11f954e8743b', 'volume_name': 'volume-673dcd55-d7f3-46d4-bef8-11f954e8743b', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (003535e4-920d-44c6-a60d-2dbf5be726e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (003535e4-920d-44c6-a60d-2dbf5be726e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f1e45a0-b52d-4b5b-bbf2-e52380d4e413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:03 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Volume 673dcd55-d7f3-46d4-bef8-11f954e8743b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-673dcd55-d7f3-46d4-bef8-11f954e8743b', 'volume_size': 1} Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1011475741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=673dcd55-d7f3-46d4-bef8-11f954e8743b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dffbdc4ba5f4aa29745369df3301428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:52:04Z,use_quota=True,user_id='d5019707bfd04767a29ca6a262757a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Creating volume 673dcd55-d7f3-46d4-bef8-11f954e8743b {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:52:03 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-673dcd55-d7f3-46d4-bef8-11f954e8743b 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:03 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-673dcd55-d7f3-46d4-bef8-11f954e8743b 1073741824 Jun 24 09:52:03 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:03 devstack cinder-volume[93447]: WARNING cinder.quota [None req-eaf75400-a967-4992-a473-ebf19f957314 tempest-SnapshotsActionsTest-1820002773 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-eaf75400-a967-4992-a473-ebf19f957314 tempest-SnapshotsActionsTest-1820002773 None] Created reservations ['45572474-dbef-423b-9afa-522880dad7d0', 'ee2879d8-1ccc-4342-85af-e0bd4f960787', '33023249-61ec-4328-bf96-7a0c1202e21b', '1b1d3fd1-2a51-4cdf-988a-dfe28500175c'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:52:03 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-eaf75400-a967-4992-a473-ebf19f957314 tempest-SnapshotsActionsTest-1820002773 None] Delete snapshot completed successfully. Jun 24 09:52:03 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-eaf75400-a967-4992-a473-ebf19f957314 tempest-SnapshotsActionsTest-1820002773 None] Lock "cinder-0b0435bd-72f8-465f-8a9a-59508292af18-delete_snapshot" released by "delete_snapshot" :: held 3.450s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:04 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-673dcd55-d7f3-46d4-bef8-11f954e8743b 1073741824" returned: 0 in 0.855s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-673dcd55-d7f3-46d4-bef8-11f954e8743b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:04 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-673dcd55-d7f3-46d4-bef8-11f954e8743b Jun 24 09:52:04 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4ffb6344-c9e8-49bb-a5a4-c0ae9d1913d5 tempest-SnapshotsActionsTest-1225648455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:05 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-673dcd55-d7f3-46d4-bef8-11f954e8743b" returned: 0 in 0.662s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:05 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:52:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4ffb6344-c9e8-49bb-a5a4-c0ae9d1913d5 tempest-SnapshotsActionsTest-1225648455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.283s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:05 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f1e45a0-b52d-4b5b-bbf2-e52380d4e413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-673dcd55-d7f3-46d4-bef8-11f954e8743b', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:05 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd3b6d33-47ce-424c-b9ea-572e354dcda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:05 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-4ffb6344-c9e8-49bb-a5a4-c0ae9d1913d5 tempest-SnapshotsActionsTest-1225648455 None] Creating offline snapshot d561d390-a36b-439c-82b1-25bf4e8c811c of volume e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 09:52:05 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Volume volume-673dcd55-d7f3-46d4-bef8-11f954e8743b (673dcd55-d7f3-46d4-bef8-11f954e8743b): created successfully Jun 24 09:52:05 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd3b6d33-47ce-424c-b9ea-572e354dcda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:05 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Flow 'volume_create_manager' (6fb3142c-c8b4-4489-8e0c-0b2e0e57db58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:52:05 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[295823ed-cf49-4498-9271-a5e968280aa3]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4ffb6344-c9e8-49bb-a5a4-c0ae9d1913d5 tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:05 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-16081177-a18c-484f-8d3b-8ecb81243bd1 tempest-VolumesListAdminTestJSON-2114967 None] Created volume successfully. Jun 24 09:52:05 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 Jun 24 09:52:05 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:06 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4ffb6344-c9e8-49bb-a5a4-c0ae9d1913d5 tempest-SnapshotsActionsTest-1225648455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972" returned: 0 in 0.959s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:06 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-4ffb6344-c9e8-49bb-a5a4-c0ae9d1913d5 tempest-SnapshotsActionsTest-1225648455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:52:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4ffb6344-c9e8-49bb-a5a4-c0ae9d1913d5 tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.d561d390-a36b-439c-82b1-25bf4e8c811c 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:06 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:52:06 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Flow 'volume_create_manager' (86619820-8851-4744-87c9-053b80d680c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:52:06 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.d561d390-a36b-439c-82b1-25bf4e8c811c 1G Jun 24 09:52:06 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:06 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd97caf2-ce73-4550-8b07-437c32c0ff33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:06 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd97caf2-ce73-4550-8b07-437c32c0ff33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1327146428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c50f56-81b8-4a7c-993a-e6e21e09fb1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dffbdc4ba5f4aa29745369df3301428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:52:06Z,use_quota=True,user_id='d5019707bfd04767a29ca6a262757a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:06 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0aa64b3-7b64-459e-ac75-e59b66732b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:06 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0aa64b3-7b64-459e-ac75-e59b66732b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:06 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (127db488-9ac7-44cd-9941-303c83b0d7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:06 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (127db488-9ac7-44cd-9941-303c83b0d7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2c50f56-81b8-4a7c-993a-e6e21e09fb1f', 'volume_name': 'volume-e2c50f56-81b8-4a7c-993a-e6e21e09fb1f', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:06 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e08335-2421-4da9-8d1e-07e348ba2058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:06 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e08335-2421-4da9-8d1e-07e348ba2058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:06 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf904c3-b1fb-4ac9-8c11-f56d0d35263f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:06 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Volume e2c50f56-81b8-4a7c-993a-e6e21e09fb1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2c50f56-81b8-4a7c-993a-e6e21e09fb1f', 'volume_size': 1} Jun 24 09:52:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:07 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4ffb6344-c9e8-49bb-a5a4-c0ae9d1913d5 tempest-SnapshotsActionsTest-1225648455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.d561d390-a36b-439c-82b1-25bf4e8c811c 1G" returned: 0 in 1.011s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4ffb6344-c9e8-49bb-a5a4-c0ae9d1913d5 tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.d561d390-a36b-439c-82b1-25bf4e8c811c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:07 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.d561d390-a36b-439c-82b1-25bf4e8c811c Jun 24 09:52:07 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:07 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4ffb6344-c9e8-49bb-a5a4-c0ae9d1913d5 tempest-SnapshotsActionsTest-1225648455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.d561d390-a36b-439c-82b1-25bf4e8c811c" returned: 0 in 0.686s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:07 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-4ffb6344-c9e8-49bb-a5a4-c0ae9d1913d5 tempest-SnapshotsActionsTest-1225648455 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.d561d390-a36b-439c-82b1-25bf4e8c811c is being set with open permissions: ugo+rw Jun 24 09:52:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4ffb6344-c9e8-49bb-a5a4-c0ae9d1913d5 tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.d561d390-a36b-439c-82b1-25bf4e8c811c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:08 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.d561d390-a36b-439c-82b1-25bf4e8c811c Jun 24 09:52:08 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:08 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4ffb6344-c9e8-49bb-a5a4-c0ae9d1913d5 tempest-SnapshotsActionsTest-1225648455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.d561d390-a36b-439c-82b1-25bf4e8c811c" returned: 0 in 0.682s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4ffb6344-c9e8-49bb-a5a4-c0ae9d1913d5 tempest-SnapshotsActionsTest-1225648455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.482s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.245s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1327146428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c50f56-81b8-4a7c-993a-e6e21e09fb1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dffbdc4ba5f4aa29745369df3301428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:52:06Z,use_quota=True,user_id='d5019707bfd04767a29ca6a262757a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:52:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Creating volume e2c50f56-81b8-4a7c-993a-e6e21e09fb1f {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:52:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:52:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:52:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:52:08 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:52:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e2c50f56-81b8-4a7c-993a-e6e21e09fb1f 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:08 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e2c50f56-81b8-4a7c-993a-e6e21e09fb1f 1073741824 Jun 24 09:52:08 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:08 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-4ffb6344-c9e8-49bb-a5a4-c0ae9d1913d5 tempest-SnapshotsActionsTest-1225648455 None] Create snapshot completed successfully Jun 24 09:52:09 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b4782518-a426-40cc-9e13-05117a5c8e5b tempest-SnapshotsActionsTest-1820002773 None] Acquiring lock "cinder-d561d390-a36b-439c-82b1-25bf4e8c811c-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:09 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b4782518-a426-40cc-9e13-05117a5c8e5b tempest-SnapshotsActionsTest-1820002773 None] Lock "cinder-d561d390-a36b-439c-82b1-25bf4e8c811c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:09 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b4782518-a426-40cc-9e13-05117a5c8e5b tempest-SnapshotsActionsTest-1820002773 None] Acquiring lock "cinder-quobyte-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:09 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b4782518-a426-40cc-9e13-05117a5c8e5b tempest-SnapshotsActionsTest-1820002773 None] Lock "cinder-quobyte-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:09 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b4782518-a426-40cc-9e13-05117a5c8e5b tempest-SnapshotsActionsTest-1820002773 None] Acquiring lock "cinder-quobyte-d561d390-a36b-439c-82b1-25bf4e8c811c" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:09 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b4782518-a426-40cc-9e13-05117a5c8e5b tempest-SnapshotsActionsTest-1820002773 None] Lock "cinder-quobyte-d561d390-a36b-439c-82b1-25bf4e8c811c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:09 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-b4782518-a426-40cc-9e13-05117a5c8e5b tempest-SnapshotsActionsTest-1820002773 None] Deleting offline snapshot d561d390-a36b-439c-82b1-25bf4e8c811c of volume e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 09:52:09 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-b4782518-a426-40cc-9e13-05117a5c8e5b tempest-SnapshotsActionsTest-1820002773 None] snapshot_file for this snap is: volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.d561d390-a36b-439c-82b1-25bf4e8c811c {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 09:52:09 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c02b6d-59c0-4cd6-bfb4-1cccfd2877c4]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b4782518-a426-40cc-9e13-05117a5c8e5b tempest-SnapshotsActionsTest-1820002773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.d561d390-a36b-439c-82b1-25bf4e8c811c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:09 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.d561d390-a36b-439c-82b1-25bf4e8c811c Jun 24 09:52:09 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:09 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e2c50f56-81b8-4a7c-993a-e6e21e09fb1f 1073741824" returned: 0 in 0.904s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e2c50f56-81b8-4a7c-993a-e6e21e09fb1f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:09 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e2c50f56-81b8-4a7c-993a-e6e21e09fb1f Jun 24 09:52:09 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:10 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b4782518-a426-40cc-9e13-05117a5c8e5b tempest-SnapshotsActionsTest-1820002773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.d561d390-a36b-439c-82b1-25bf4e8c811c" returned: 0 in 0.791s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-b4782518-a426-40cc-9e13-05117a5c8e5b tempest-SnapshotsActionsTest-1820002773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5000d7-6a89-42d9-823f-6cabbcd3d5e7]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b4782518-a426-40cc-9e13-05117a5c8e5b tempest-SnapshotsActionsTest-1820002773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:10 devstack sudo[102095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 Jun 24 09:52:10 devstack sudo[102095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:10 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e2c50f56-81b8-4a7c-993a-e6e21e09fb1f" returned: 0 in 0.710s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccf904c3-b1fb-4ac9-8c11-f56d0d35263f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2c50f56-81b8-4a7c-993a-e6e21e09fb1f', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015d9dcb-06a7-4905-ad14-4c31ce85cc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Flow 'volume_create_manager' (1e7c56c0-215c-49ac-9577-242e3cd17990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d081c54-b2a7-4297-b5ba-833ed6f29969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:10 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Volume volume-e2c50f56-81b8-4a7c-993a-e6e21e09fb1f (e2c50f56-81b8-4a7c-993a-e6e21e09fb1f): created successfully Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015d9dcb-06a7-4905-ad14-4c31ce85cc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Flow 'volume_create_manager' (86619820-8851-4744-87c9-053b80d680c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d081c54-b2a7-4297-b5ba-833ed6f29969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1058373712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d302b6-8ece-4e1c-90a9-dbdc2839dbda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8574cb4538ed4694bb436a999b118f4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:52:10Z,use_quota=True,user_id='15f41a1d662343f097ed20cdbc4116f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b29784f-7d2f-450a-bc9b-4ddd11d6aa3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b29784f-7d2f-450a-bc9b-4ddd11d6aa3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e180f36-b00d-4c58-adfe-c776f7e58bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e180f36-b00d-4c58-adfe-c776f7e58bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20d302b6-8ece-4e1c-90a9-dbdc2839dbda', 'volume_name': 'volume-20d302b6-8ece-4e1c-90a9-dbdc2839dbda', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6e268a-ba01-4fd5-b794-98dd2086a43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6e268a-ba01-4fd5-b794-98dd2086a43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c2701e-e10d-4768-8735-e18d992bb340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:10 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Volume 20d302b6-8ece-4e1c-90a9-dbdc2839dbda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20d302b6-8ece-4e1c-90a9-dbdc2839dbda', 'volume_size': 1} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1058373712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d302b6-8ece-4e1c-90a9-dbdc2839dbda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8574cb4538ed4694bb436a999b118f4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:52:10Z,use_quota=True,user_id='15f41a1d662343f097ed20cdbc4116f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Creating volume 20d302b6-8ece-4e1c-90a9-dbdc2839dbda {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:52:10 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:52:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-20d302b6-8ece-4e1c-90a9-dbdc2839dbda 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:10 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-81806361-95d1-4054-b64e-4628765a9374 tempest-VolumesListAdminTestJSON-2114967 None] Created volume successfully. Jun 24 09:52:10 devstack sudo[102098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-20d302b6-8ece-4e1c-90a9-dbdc2839dbda 1073741824 Jun 24 09:52:10 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:11 devstack sudo[102095]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b4782518-a426-40cc-9e13-05117a5c8e5b tempest-SnapshotsActionsTest-1820002773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972" returned: 0 in 0.802s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:11 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-b4782518-a426-40cc-9e13-05117a5c8e5b tempest-SnapshotsActionsTest-1820002773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:52:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b4782518-a426-40cc-9e13-05117a5c8e5b tempest-SnapshotsActionsTest-1820002773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.d561d390-a36b-439c-82b1-25bf4e8c811c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:11 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.d561d390-a36b-439c-82b1-25bf4e8c811c Jun 24 09:52:11 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:11 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-20d302b6-8ece-4e1c-90a9-dbdc2839dbda 1073741824" returned: 0 in 0.827s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-20d302b6-8ece-4e1c-90a9-dbdc2839dbda {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:11 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-20d302b6-8ece-4e1c-90a9-dbdc2839dbda Jun 24 09:52:11 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:11 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b4782518-a426-40cc-9e13-05117a5c8e5b tempest-SnapshotsActionsTest-1820002773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.d561d390-a36b-439c-82b1-25bf4e8c811c" returned: 0 in 0.817s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b4782518-a426-40cc-9e13-05117a5c8e5b tempest-SnapshotsActionsTest-1820002773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.d561d390-a36b-439c-82b1-25bf4e8c811c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:11 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.d561d390-a36b-439c-82b1-25bf4e8c811c Jun 24 09:52:11 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:12 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-20d302b6-8ece-4e1c-90a9-dbdc2839dbda" returned: 0 in 0.704s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c2701e-e10d-4768-8735-e18d992bb340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20d302b6-8ece-4e1c-90a9-dbdc2839dbda', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4343a8f-c707-4a60-af3b-911a339164d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:12 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Volume volume-20d302b6-8ece-4e1c-90a9-dbdc2839dbda (20d302b6-8ece-4e1c-90a9-dbdc2839dbda): created successfully Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4343a8f-c707-4a60-af3b-911a339164d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Flow 'volume_create_manager' (1e7c56c0-215c-49ac-9577-242e3cd17990) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:52:12 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-72eee690-bb65-487f-8d15-7b1593e7a947 tempest-AttachVolumeNegativeTest-2082640456 None] Created volume successfully. Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Flow 'volume_create_manager' (ef199aab-eb8b-458a-9757-2f88f66bce66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cae697-00d5-44c3-8ff9-b7bb94e80c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cae697-00d5-44c3-8ff9-b7bb94e80c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1fcb45-de18-4819-86e2-cedb4a0a82ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a4180e9afa4eeea90d984b09eeedc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:52:12Z,use_quota=True,user_id='d2f09f1e7f43412db9275ddac87dfe01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ee0168-ffa4-4805-83e6-711d18641f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ee0168-ffa4-4805-83e6-711d18641f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3247110-19f6-4927-a24d-c4c828f1701c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3247110-19f6-4927-a24d-c4c828f1701c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e1fcb45-de18-4819-86e2-cedb4a0a82ec', 'volume_name': 'volume-4e1fcb45-de18-4819-86e2-cedb4a0a82ec', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395b2ee7-2345-49a0-a747-5e2024c86b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395b2ee7-2345-49a0-a747-5e2024c86b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19abd0b1-13ea-4037-b3eb-4ed8e4c3bdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:12 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Volume 4e1fcb45-de18-4819-86e2-cedb4a0a82ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e1fcb45-de18-4819-86e2-cedb4a0a82ec', 'volume_size': 1} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1fcb45-de18-4819-86e2-cedb4a0a82ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a4180e9afa4eeea90d984b09eeedc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:52:12Z,use_quota=True,user_id='d2f09f1e7f43412db9275ddac87dfe01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Creating volume 4e1fcb45-de18-4819-86e2-cedb4a0a82ec {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:52:12 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-4e1fcb45-de18-4819-86e2-cedb4a0a82ec 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:12 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-4e1fcb45-de18-4819-86e2-cedb4a0a82ec 1073741824 Jun 24 09:52:12 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:12 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b4782518-a426-40cc-9e13-05117a5c8e5b tempest-SnapshotsActionsTest-1820002773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.d561d390-a36b-439c-82b1-25bf4e8c811c" returned: 0 in 0.707s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b4782518-a426-40cc-9e13-05117a5c8e5b tempest-SnapshotsActionsTest-1820002773 None] Lock "cinder-quobyte-d561d390-a36b-439c-82b1-25bf4e8c811c" released by "_delete_snapshot" :: held 3.249s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b4782518-a426-40cc-9e13-05117a5c8e5b tempest-SnapshotsActionsTest-1820002773 None] Lock "cinder-quobyte-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585" released by "delete_snapshot" :: held 3.278s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-b4782518-a426-40cc-9e13-05117a5c8e5b tempest-SnapshotsActionsTest-1820002773 None] Created reservations ['a37336f7-43c1-4e29-a0ff-6b58427c4e1d', 'c72437de-e89d-4a6e-bf84-c5da9ed6bafc', '7a56570c-e9b6-470b-ba1c-f1e1e3688fa6', 'bedf5b32-b230-4a0b-bb41-41b43e09d1e6'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:52:12 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-b4782518-a426-40cc-9e13-05117a5c8e5b tempest-SnapshotsActionsTest-1820002773 None] Delete snapshot completed successfully. Jun 24 09:52:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b4782518-a426-40cc-9e13-05117a5c8e5b tempest-SnapshotsActionsTest-1820002773 None] Lock "cinder-d561d390-a36b-439c-82b1-25bf4e8c811c-delete_snapshot" released by "delete_snapshot" :: held 3.413s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:13 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-4e1fcb45-de18-4819-86e2-cedb4a0a82ec 1073741824" returned: 0 in 0.846s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-4e1fcb45-de18-4819-86e2-cedb4a0a82ec {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:13 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-4e1fcb45-de18-4819-86e2-cedb4a0a82ec Jun 24 09:52:13 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-acaa0d86-ae18-4272-b341-9c551d0778e4 tempest-SnapshotsActionsTest-1225648455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:13 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-4e1fcb45-de18-4819-86e2-cedb4a0a82ec" returned: 0 in 0.677s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:52:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-acaa0d86-ae18-4272-b341-9c551d0778e4 tempest-SnapshotsActionsTest-1225648455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.057s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-acaa0d86-ae18-4272-b341-9c551d0778e4 tempest-SnapshotsActionsTest-1225648455 None] Creating offline snapshot cc1f8619-79e3-4e6b-9223-620da57c5401 of volume e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 09:52:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19abd0b1-13ea-4037-b3eb-4ed8e4c3bdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e1fcb45-de18-4819-86e2-cedb4a0a82ec', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11d12e2-5050-4ca8-9e77-94374ee1856f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:13 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a81106c-6f3f-43c0-be75-fe517c8b535b]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-acaa0d86-ae18-4272-b341-9c551d0778e4 tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:13 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Volume volume-4e1fcb45-de18-4819-86e2-cedb4a0a82ec (4e1fcb45-de18-4819-86e2-cedb4a0a82ec): created successfully Jun 24 09:52:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11d12e2-5050-4ca8-9e77-94374ee1856f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Flow 'volume_create_manager' (ef199aab-eb8b-458a-9757-2f88f66bce66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:52:13 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-143a996c-8337-469a-8085-d2b35f6fbb1c tempest-VolumesListAdminTestJSON-1078394452 None] Created volume successfully. Jun 24 09:52:14 devstack sudo[102131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 Jun 24 09:52:14 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:14 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-18a67a39-519e-493a-aea6-2f6d5f5121ad tempest-VolumesListAdminTestJSON-1078394452 None] Acquiring lock "cinder-4e1fcb45-de18-4819-86e2-cedb4a0a82ec-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:14 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-18a67a39-519e-493a-aea6-2f6d5f5121ad tempest-VolumesListAdminTestJSON-1078394452 None] Lock "cinder-4e1fcb45-de18-4819-86e2-cedb4a0a82ec-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:14 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-18a67a39-519e-493a-aea6-2f6d5f5121ad tempest-VolumesListAdminTestJSON-1078394452 None] Acquiring lock "cinder-quobyte-4e1fcb45-de18-4819-86e2-cedb4a0a82ec" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:14 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-18a67a39-519e-493a-aea6-2f6d5f5121ad tempest-VolumesListAdminTestJSON-1078394452 None] Lock "cinder-quobyte-4e1fcb45-de18-4819-86e2-cedb4a0a82ec" acquired by "delete_volume" :: waited 0.015s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:14 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8dc8bb-417b-4b20-b26b-23d7087408eb]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-18a67a39-519e-493a-aea6-2f6d5f5121ad tempest-VolumesListAdminTestJSON-1078394452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-4e1fcb45-de18-4819-86e2-cedb4a0a82ec {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:14 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-99adb951-4de3-4d87-a37b-e8d8e3a6f84d tempest-VolumesListAdminTestJSON-2114967 None] Acquiring lock "cinder-e2c50f56-81b8-4a7c-993a-e6e21e09fb1f-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:14 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-99adb951-4de3-4d87-a37b-e8d8e3a6f84d tempest-VolumesListAdminTestJSON-2114967 None] Lock "cinder-e2c50f56-81b8-4a7c-993a-e6e21e09fb1f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:14 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-4e1fcb45-de18-4819-86e2-cedb4a0a82ec Jun 24 09:52:14 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:14 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-99adb951-4de3-4d87-a37b-e8d8e3a6f84d tempest-VolumesListAdminTestJSON-2114967 None] Acquiring lock "cinder-quobyte-e2c50f56-81b8-4a7c-993a-e6e21e09fb1f" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:14 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-99adb951-4de3-4d87-a37b-e8d8e3a6f84d tempest-VolumesListAdminTestJSON-2114967 None] Lock "cinder-quobyte-e2c50f56-81b8-4a7c-993a-e6e21e09fb1f" acquired by "delete_volume" :: waited 0.018s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:14 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e21af2-66ab-4f37-84bd-201003afcc00]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-99adb951-4de3-4d87-a37b-e8d8e3a6f84d tempest-VolumesListAdminTestJSON-2114967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e2c50f56-81b8-4a7c-993a-e6e21e09fb1f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:14 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e2c50f56-81b8-4a7c-993a-e6e21e09fb1f Jun 24 09:52:14 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:14 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-acaa0d86-ae18-4272-b341-9c551d0778e4 tempest-SnapshotsActionsTest-1225648455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972" returned: 0 in 0.860s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:14 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-acaa0d86-ae18-4272-b341-9c551d0778e4 tempest-SnapshotsActionsTest-1225648455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:52:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-acaa0d86-ae18-4272-b341-9c551d0778e4 tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.cc1f8619-79e3-4e6b-9223-620da57c5401 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:14 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.cc1f8619-79e3-4e6b-9223-620da57c5401 1G Jun 24 09:52:14 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:15 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-18a67a39-519e-493a-aea6-2f6d5f5121ad tempest-VolumesListAdminTestJSON-1078394452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-4e1fcb45-de18-4819-86e2-cedb4a0a82ec" returned: 0 in 1.074s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-18a67a39-519e-493a-aea6-2f6d5f5121ad tempest-VolumesListAdminTestJSON-1078394452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-4e1fcb45-de18-4819-86e2-cedb4a0a82ec {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:15 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-4e1fcb45-de18-4819-86e2-cedb4a0a82ec Jun 24 09:52:15 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:15 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-99adb951-4de3-4d87-a37b-e8d8e3a6f84d tempest-VolumesListAdminTestJSON-2114967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e2c50f56-81b8-4a7c-993a-e6e21e09fb1f" returned: 0 in 1.113s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-99adb951-4de3-4d87-a37b-e8d8e3a6f84d tempest-VolumesListAdminTestJSON-2114967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e2c50f56-81b8-4a7c-993a-e6e21e09fb1f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:15 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e2c50f56-81b8-4a7c-993a-e6e21e09fb1f Jun 24 09:52:15 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-10e694cd-e54a-4e30-9a0f-4254e8a86f30 req-f7786d2a-51d1-4cf8-9265-a9126c5cc636 tempest-AttachVolumeNegativeTest-2082640456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:16 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-acaa0d86-ae18-4272-b341-9c551d0778e4 tempest-SnapshotsActionsTest-1225648455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.cc1f8619-79e3-4e6b-9223-620da57c5401 1G" returned: 0 in 1.286s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-acaa0d86-ae18-4272-b341-9c551d0778e4 tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.cc1f8619-79e3-4e6b-9223-620da57c5401 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:16 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.cc1f8619-79e3-4e6b-9223-620da57c5401 Jun 24 09:52:16 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:16 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-18a67a39-519e-493a-aea6-2f6d5f5121ad tempest-VolumesListAdminTestJSON-1078394452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-4e1fcb45-de18-4819-86e2-cedb4a0a82ec" returned: 0 in 0.899s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:16 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-99adb951-4de3-4d87-a37b-e8d8e3a6f84d tempest-VolumesListAdminTestJSON-2114967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e2c50f56-81b8-4a7c-993a-e6e21e09fb1f" returned: 0 in 0.694s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-18a67a39-519e-493a-aea6-2f6d5f5121ad tempest-VolumesListAdminTestJSON-1078394452 None] Lock "cinder-quobyte-4e1fcb45-de18-4819-86e2-cedb4a0a82ec" released by "delete_volume" :: held 2.030s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-99adb951-4de3-4d87-a37b-e8d8e3a6f84d tempest-VolumesListAdminTestJSON-2114967 None] Lock "cinder-quobyte-e2c50f56-81b8-4a7c-993a-e6e21e09fb1f" released by "delete_volume" :: held 1.859s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-18a67a39-519e-493a-aea6-2f6d5f5121ad tempest-VolumesListAdminTestJSON-1078394452 None] Created reservations ['181893ae-2088-4c02-a627-e3ef844e316a', 'ebadd084-a882-41f9-abf3-57b6884a46ea', '6d014506-b40d-489b-8f83-ec1f985a7652', '2cfa82f6-aea7-4157-86de-c20a11bd7566'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-99adb951-4de3-4d87-a37b-e8d8e3a6f84d tempest-VolumesListAdminTestJSON-2114967 None] Created reservations ['42514b66-8671-49ec-b8fe-dcd5c1770dca', '481538b2-c0ee-4976-a7d0-eed3c26b7e82', 'e248439b-56a6-424a-8c0e-1ee81589340f', '34b53533-943f-46f5-90ae-9ccf0148d92d'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-18a67a39-519e-493a-aea6-2f6d5f5121ad tempest-VolumesListAdminTestJSON-1078394452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-18a67a39-519e-493a-aea6-2f6d5f5121ad tempest-VolumesListAdminTestJSON-1078394452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-18a67a39-519e-493a-aea6-2f6d5f5121ad tempest-VolumesListAdminTestJSON-1078394452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-18a67a39-519e-493a-aea6-2f6d5f5121ad tempest-VolumesListAdminTestJSON-1078394452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-18a67a39-519e-493a-aea6-2f6d5f5121ad tempest-VolumesListAdminTestJSON-1078394452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-18a67a39-519e-493a-aea6-2f6d5f5121ad tempest-VolumesListAdminTestJSON-1078394452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-99adb951-4de3-4d87-a37b-e8d8e3a6f84d tempest-VolumesListAdminTestJSON-2114967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-99adb951-4de3-4d87-a37b-e8d8e3a6f84d tempest-VolumesListAdminTestJSON-2114967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-99adb951-4de3-4d87-a37b-e8d8e3a6f84d tempest-VolumesListAdminTestJSON-2114967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:52:16 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:52:16 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-99adb951-4de3-4d87-a37b-e8d8e3a6f84d tempest-VolumesListAdminTestJSON-2114967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-99adb951-4de3-4d87-a37b-e8d8e3a6f84d tempest-VolumesListAdminTestJSON-2114967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-99adb951-4de3-4d87-a37b-e8d8e3a6f84d tempest-VolumesListAdminTestJSON-2114967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:16 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:52:16 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1d6fe91e-ee48-4ac3-bbca-bc860c685f89 tempest-VolumesListAdminTestJSON-2114967 None] Acquiring lock "cinder-673dcd55-d7f3-46d4-bef8-11f954e8743b-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1d6fe91e-ee48-4ac3-bbca-bc860c685f89 tempest-VolumesListAdminTestJSON-2114967 None] Lock "cinder-673dcd55-d7f3-46d4-bef8-11f954e8743b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:16 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-acaa0d86-ae18-4272-b341-9c551d0778e4 tempest-SnapshotsActionsTest-1225648455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.cc1f8619-79e3-4e6b-9223-620da57c5401" returned: 0 in 0.831s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:16 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-acaa0d86-ae18-4272-b341-9c551d0778e4 tempest-SnapshotsActionsTest-1225648455 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.cc1f8619-79e3-4e6b-9223-620da57c5401 is being set with open permissions: ugo+rw Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-acaa0d86-ae18-4272-b341-9c551d0778e4 tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.cc1f8619-79e3-4e6b-9223-620da57c5401 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:16 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.cc1f8619-79e3-4e6b-9223-620da57c5401 Jun 24 09:52:16 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1d6fe91e-ee48-4ac3-bbca-bc860c685f89 tempest-VolumesListAdminTestJSON-2114967 None] Acquiring lock "cinder-quobyte-673dcd55-d7f3-46d4-bef8-11f954e8743b" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1d6fe91e-ee48-4ac3-bbca-bc860c685f89 tempest-VolumesListAdminTestJSON-2114967 None] Lock "cinder-quobyte-673dcd55-d7f3-46d4-bef8-11f954e8743b" acquired by "delete_volume" :: waited 0.017s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d48009e-29f3-44a0-b284-f023d4226694]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1d6fe91e-ee48-4ac3-bbca-bc860c685f89 tempest-VolumesListAdminTestJSON-2114967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-673dcd55-d7f3-46d4-bef8-11f954e8743b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:17 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-673dcd55-d7f3-46d4-bef8-11f954e8743b Jun 24 09:52:17 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:17 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-18a67a39-519e-493a-aea6-2f6d5f5121ad tempest-VolumesListAdminTestJSON-1078394452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.721s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:17 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-18a67a39-519e-493a-aea6-2f6d5f5121ad tempest-VolumesListAdminTestJSON-1078394452 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:52:17 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-18a67a39-519e-493a-aea6-2f6d5f5121ad tempest-VolumesListAdminTestJSON-1078394452 None] Deleted volume successfully. Jun 24 09:52:17 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-18a67a39-519e-493a-aea6-2f6d5f5121ad tempest-VolumesListAdminTestJSON-1078394452 None] Lock "cinder-4e1fcb45-de18-4819-86e2-cedb4a0a82ec-delete_volume" released by "delete_volume" :: held 2.998s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:17 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-99adb951-4de3-4d87-a37b-e8d8e3a6f84d tempest-VolumesListAdminTestJSON-2114967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.761s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:17 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-99adb951-4de3-4d87-a37b-e8d8e3a6f84d tempest-VolumesListAdminTestJSON-2114967 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:52:17 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-99adb951-4de3-4d87-a37b-e8d8e3a6f84d tempest-VolumesListAdminTestJSON-2114967 None] Deleted volume successfully. Jun 24 09:52:17 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-99adb951-4de3-4d87-a37b-e8d8e3a6f84d tempest-VolumesListAdminTestJSON-2114967 None] Lock "cinder-e2c50f56-81b8-4a7c-993a-e6e21e09fb1f-delete_volume" released by "delete_volume" :: held 2.905s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:17 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-acaa0d86-ae18-4272-b341-9c551d0778e4 tempest-SnapshotsActionsTest-1225648455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.cc1f8619-79e3-4e6b-9223-620da57c5401" returned: 0 in 0.715s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-acaa0d86-ae18-4272-b341-9c551d0778e4 tempest-SnapshotsActionsTest-1225648455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.787s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-10e694cd-e54a-4e30-9a0f-4254e8a86f30 req-f7786d2a-51d1-4cf8-9265-a9126c5cc636 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.843s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:17 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8697ec-9ad0-4932-a382-82a0923266d8]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-10e694cd-e54a-4e30-9a0f-4254e8a86f30 req-f7786d2a-51d1-4cf8-9265-a9126c5cc636 tempest-AttachVolumeNegativeTest-2082640456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-20d302b6-8ece-4e1c-90a9-dbdc2839dbda {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:17 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-acaa0d86-ae18-4272-b341-9c551d0778e4 tempest-SnapshotsActionsTest-1225648455 None] Create snapshot completed successfully Jun 24 09:52:17 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-20d302b6-8ece-4e1c-90a9-dbdc2839dbda Jun 24 09:52:17 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:17 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1d6fe91e-ee48-4ac3-bbca-bc860c685f89 tempest-VolumesListAdminTestJSON-2114967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-673dcd55-d7f3-46d4-bef8-11f954e8743b" returned: 0 in 0.827s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1d6fe91e-ee48-4ac3-bbca-bc860c685f89 tempest-VolumesListAdminTestJSON-2114967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-673dcd55-d7f3-46d4-bef8-11f954e8743b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:17 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-673dcd55-d7f3-46d4-bef8-11f954e8743b Jun 24 09:52:17 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:18 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-88820cc3-d7d0-4bbd-8c67-bf5b07e1f240 tempest-SnapshotsActionsTest-1820002773 None] Acquiring lock "cinder-cc1f8619-79e3-4e6b-9223-620da57c5401-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:18 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-88820cc3-d7d0-4bbd-8c67-bf5b07e1f240 tempest-SnapshotsActionsTest-1820002773 None] Lock "cinder-cc1f8619-79e3-4e6b-9223-620da57c5401-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:18 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-88820cc3-d7d0-4bbd-8c67-bf5b07e1f240 tempest-SnapshotsActionsTest-1820002773 None] Acquiring lock "cinder-quobyte-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:18 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-88820cc3-d7d0-4bbd-8c67-bf5b07e1f240 tempest-SnapshotsActionsTest-1820002773 None] Lock "cinder-quobyte-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:18 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-88820cc3-d7d0-4bbd-8c67-bf5b07e1f240 tempest-SnapshotsActionsTest-1820002773 None] Acquiring lock "cinder-quobyte-cc1f8619-79e3-4e6b-9223-620da57c5401" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:18 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-88820cc3-d7d0-4bbd-8c67-bf5b07e1f240 tempest-SnapshotsActionsTest-1820002773 None] Lock "cinder-quobyte-cc1f8619-79e3-4e6b-9223-620da57c5401" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:18 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-88820cc3-d7d0-4bbd-8c67-bf5b07e1f240 tempest-SnapshotsActionsTest-1820002773 None] Deleting offline snapshot cc1f8619-79e3-4e6b-9223-620da57c5401 of volume e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 09:52:18 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-88820cc3-d7d0-4bbd-8c67-bf5b07e1f240 tempest-SnapshotsActionsTest-1820002773 None] snapshot_file for this snap is: volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.cc1f8619-79e3-4e6b-9223-620da57c5401 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 09:52:18 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[476c9bbf-5940-4982-813e-7f0b33f3d85d]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-88820cc3-d7d0-4bbd-8c67-bf5b07e1f240 tempest-SnapshotsActionsTest-1820002773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.cc1f8619-79e3-4e6b-9223-620da57c5401 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:18 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.cc1f8619-79e3-4e6b-9223-620da57c5401 Jun 24 09:52:18 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:18 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-10e694cd-e54a-4e30-9a0f-4254e8a86f30 req-f7786d2a-51d1-4cf8-9265-a9126c5cc636 tempest-AttachVolumeNegativeTest-2082640456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-20d302b6-8ece-4e1c-90a9-dbdc2839dbda" returned: 0 in 0.939s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-10e694cd-e54a-4e30-9a0f-4254e8a86f30 req-f7786d2a-51d1-4cf8-9265-a9126c5cc636 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.957s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-10e694cd-e54a-4e30-9a0f-4254e8a86f30 req-f7786d2a-51d1-4cf8-9265-a9126c5cc636 tempest-AttachVolumeNegativeTest-2082640456 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb', 'name': 'volume-20d302b6-8ece-4e1c-90a9-dbdc2839dbda', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '549e1d89-9412-4d5d-9bf9-5695e131085a', 'enforce_multipath': True} {{(pid=93447) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 09:52:18 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1d6fe91e-ee48-4ac3-bbca-bc860c685f89 tempest-VolumesListAdminTestJSON-2114967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-673dcd55-d7f3-46d4-bef8-11f954e8743b" returned: 0 in 0.855s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:18 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1d6fe91e-ee48-4ac3-bbca-bc860c685f89 tempest-VolumesListAdminTestJSON-2114967 None] Lock "cinder-quobyte-673dcd55-d7f3-46d4-bef8-11f954e8743b" released by "delete_volume" :: held 1.727s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:18 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-10e694cd-e54a-4e30-9a0f-4254e8a86f30 req-f7786d2a-51d1-4cf8-9265-a9126c5cc636 tempest-AttachVolumeNegativeTest-2082640456 None] attachment_update completed successfully. Jun 24 09:52:18 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-1d6fe91e-ee48-4ac3-bbca-bc860c685f89 tempest-VolumesListAdminTestJSON-2114967 None] Created reservations ['37c22a29-6e2c-442e-8e0b-7fb7d8c72f6b', '6f72aec3-a25a-4951-ac1c-cedb738cccae', 'd67409c6-d550-4d25-ac8b-463acc605daf', '15a8fa65-8eec-40ed-b084-06dfdaac28f2'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:52:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1d6fe91e-ee48-4ac3-bbca-bc860c685f89 tempest-VolumesListAdminTestJSON-2114967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1d6fe91e-ee48-4ac3-bbca-bc860c685f89 tempest-VolumesListAdminTestJSON-2114967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:18 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1d6fe91e-ee48-4ac3-bbca-bc860c685f89 tempest-VolumesListAdminTestJSON-2114967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:52:18 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1d6fe91e-ee48-4ac3-bbca-bc860c685f89 tempest-VolumesListAdminTestJSON-2114967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:52:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1d6fe91e-ee48-4ac3-bbca-bc860c685f89 tempest-VolumesListAdminTestJSON-2114967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1d6fe91e-ee48-4ac3-bbca-bc860c685f89 tempest-VolumesListAdminTestJSON-2114967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:18 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:52:18 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:19 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-876a5364-0e52-486e-bb41-d41e6d0ca81a tempest-VolumesListAdminTestJSON-2114967 None] Acquiring lock "cinder-32e0a7ce-aa59-4ec6-911e-a221dc35c430-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:19 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-876a5364-0e52-486e-bb41-d41e6d0ca81a tempest-VolumesListAdminTestJSON-2114967 None] Lock "cinder-32e0a7ce-aa59-4ec6-911e-a221dc35c430-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:19 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-876a5364-0e52-486e-bb41-d41e6d0ca81a tempest-VolumesListAdminTestJSON-2114967 None] Acquiring lock "cinder-quobyte-32e0a7ce-aa59-4ec6-911e-a221dc35c430" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:19 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-876a5364-0e52-486e-bb41-d41e6d0ca81a tempest-VolumesListAdminTestJSON-2114967 None] Lock "cinder-quobyte-32e0a7ce-aa59-4ec6-911e-a221dc35c430" acquired by "delete_volume" :: waited 0.014s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:19 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[642fe02a-4888-4a54-88de-eff8cd9bc034]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-876a5364-0e52-486e-bb41-d41e6d0ca81a tempest-VolumesListAdminTestJSON-2114967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-32e0a7ce-aa59-4ec6-911e-a221dc35c430 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:19 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-88820cc3-d7d0-4bbd-8c67-bf5b07e1f240 tempest-SnapshotsActionsTest-1820002773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.cc1f8619-79e3-4e6b-9223-620da57c5401" returned: 0 in 0.900s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:19 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-88820cc3-d7d0-4bbd-8c67-bf5b07e1f240 tempest-SnapshotsActionsTest-1820002773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:52:19 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5f37a0-05b9-4eb6-b206-ec2e2075a942]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-88820cc3-d7d0-4bbd-8c67-bf5b07e1f240 tempest-SnapshotsActionsTest-1820002773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:19 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-32e0a7ce-aa59-4ec6-911e-a221dc35c430 Jun 24 09:52:19 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:19 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 Jun 24 09:52:19 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:19 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1d6fe91e-ee48-4ac3-bbca-bc860c685f89 tempest-VolumesListAdminTestJSON-2114967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.840s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:19 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-1d6fe91e-ee48-4ac3-bbca-bc860c685f89 tempest-VolumesListAdminTestJSON-2114967 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:52:19 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-1d6fe91e-ee48-4ac3-bbca-bc860c685f89 tempest-VolumesListAdminTestJSON-2114967 None] Deleted volume successfully. Jun 24 09:52:19 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1d6fe91e-ee48-4ac3-bbca-bc860c685f89 tempest-VolumesListAdminTestJSON-2114967 None] Lock "cinder-673dcd55-d7f3-46d4-bef8-11f954e8743b-delete_volume" released by "delete_volume" :: held 2.858s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:20 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-3462b519-e7a2-437b-aa27-31d259836eee req-62ecc5d2-c9bc-49e1-949a-ef36f47a259f tempest-AttachVolumeTestJSON-524336646 None] Terminate volume connection completed successfully. Jun 24 09:52:20 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-3462b519-e7a2-437b-aa27-31d259836eee req-62ecc5d2-c9bc-49e1-949a-ef36f47a259f tempest-AttachVolumeTestJSON-524336646 None] Deleting attachment 3deff444-42d1-4396-b7e1-d1d816a028b4. {{(pid=93447) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 09:52:20 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-876a5364-0e52-486e-bb41-d41e6d0ca81a tempest-VolumesListAdminTestJSON-2114967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-32e0a7ce-aa59-4ec6-911e-a221dc35c430" returned: 0 in 0.905s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-876a5364-0e52-486e-bb41-d41e6d0ca81a tempest-VolumesListAdminTestJSON-2114967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-32e0a7ce-aa59-4ec6-911e-a221dc35c430 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:20 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-32e0a7ce-aa59-4ec6-911e-a221dc35c430 Jun 24 09:52:20 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:20 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-88820cc3-d7d0-4bbd-8c67-bf5b07e1f240 tempest-SnapshotsActionsTest-1820002773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972" returned: 0 in 0.980s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:20 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-88820cc3-d7d0-4bbd-8c67-bf5b07e1f240 tempest-SnapshotsActionsTest-1820002773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:52:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-88820cc3-d7d0-4bbd-8c67-bf5b07e1f240 tempest-SnapshotsActionsTest-1820002773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.cc1f8619-79e3-4e6b-9223-620da57c5401 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:20 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.cc1f8619-79e3-4e6b-9223-620da57c5401 Jun 24 09:52:20 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:20 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-876a5364-0e52-486e-bb41-d41e6d0ca81a tempest-VolumesListAdminTestJSON-2114967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-32e0a7ce-aa59-4ec6-911e-a221dc35c430" returned: 0 in 0.655s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:20 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-876a5364-0e52-486e-bb41-d41e6d0ca81a tempest-VolumesListAdminTestJSON-2114967 None] Lock "cinder-quobyte-32e0a7ce-aa59-4ec6-911e-a221dc35c430" released by "delete_volume" :: held 1.613s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:20 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-876a5364-0e52-486e-bb41-d41e6d0ca81a tempest-VolumesListAdminTestJSON-2114967 None] Created reservations ['a88922a1-24dc-4bea-9b1c-f530aae74fa8', '9d537a39-1191-45bf-a438-249989766e36', '63db84b3-b9ff-4069-8ac2-3e0e389d0066', '210804c2-8a04-4015-bd7d-341e6fdee0aa'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:52:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-876a5364-0e52-486e-bb41-d41e6d0ca81a tempest-VolumesListAdminTestJSON-2114967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-876a5364-0e52-486e-bb41-d41e6d0ca81a tempest-VolumesListAdminTestJSON-2114967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:20 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-876a5364-0e52-486e-bb41-d41e6d0ca81a tempest-VolumesListAdminTestJSON-2114967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:52:20 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-876a5364-0e52-486e-bb41-d41e6d0ca81a tempest-VolumesListAdminTestJSON-2114967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:52:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-876a5364-0e52-486e-bb41-d41e6d0ca81a tempest-VolumesListAdminTestJSON-2114967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-876a5364-0e52-486e-bb41-d41e6d0ca81a tempest-VolumesListAdminTestJSON-2114967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:20 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:52:20 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:21 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-88820cc3-d7d0-4bbd-8c67-bf5b07e1f240 tempest-SnapshotsActionsTest-1820002773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.cc1f8619-79e3-4e6b-9223-620da57c5401" returned: 0 in 0.918s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-88820cc3-d7d0-4bbd-8c67-bf5b07e1f240 tempest-SnapshotsActionsTest-1820002773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.cc1f8619-79e3-4e6b-9223-620da57c5401 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:21 devstack sudo[102274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.cc1f8619-79e3-4e6b-9223-620da57c5401 Jun 24 09:52:21 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:21 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-876a5364-0e52-486e-bb41-d41e6d0ca81a tempest-VolumesListAdminTestJSON-2114967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.668s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:21 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-876a5364-0e52-486e-bb41-d41e6d0ca81a tempest-VolumesListAdminTestJSON-2114967 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:52:21 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-876a5364-0e52-486e-bb41-d41e6d0ca81a tempest-VolumesListAdminTestJSON-2114967 None] Deleted volume successfully. Jun 24 09:52:21 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-876a5364-0e52-486e-bb41-d41e6d0ca81a tempest-VolumesListAdminTestJSON-2114967 None] Lock "cinder-32e0a7ce-aa59-4ec6-911e-a221dc35c430-delete_volume" released by "delete_volume" :: held 2.536s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:21 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-88820cc3-d7d0-4bbd-8c67-bf5b07e1f240 tempest-SnapshotsActionsTest-1820002773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.cc1f8619-79e3-4e6b-9223-620da57c5401" returned: 0 in 0.743s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:21 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-88820cc3-d7d0-4bbd-8c67-bf5b07e1f240 tempest-SnapshotsActionsTest-1820002773 None] Lock "cinder-quobyte-cc1f8619-79e3-4e6b-9223-620da57c5401" released by "_delete_snapshot" :: held 3.674s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:21 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-88820cc3-d7d0-4bbd-8c67-bf5b07e1f240 tempest-SnapshotsActionsTest-1820002773 None] Lock "cinder-quobyte-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585" released by "delete_snapshot" :: held 3.709s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:22 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-88820cc3-d7d0-4bbd-8c67-bf5b07e1f240 tempest-SnapshotsActionsTest-1820002773 None] Created reservations ['b1d51acf-7846-4b97-b053-4bba090dfc4e', '482b72ab-2986-49e2-93a0-571e016997c4', '5e6affef-d7ec-4b69-8745-13f21dcbc61e', 'e4159ad9-55d2-4738-861b-8882f78d3ec4'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:52:22 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-88820cc3-d7d0-4bbd-8c67-bf5b07e1f240 tempest-SnapshotsActionsTest-1820002773 None] Delete snapshot completed successfully. Jun 24 09:52:22 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-88820cc3-d7d0-4bbd-8c67-bf5b07e1f240 tempest-SnapshotsActionsTest-1820002773 None] Lock "cinder-cc1f8619-79e3-4e6b-9223-620da57c5401-delete_snapshot" released by "delete_snapshot" :: held 3.848s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4110df28-d17e-4ae2-b3f5-579c0912efda tempest-SnapshotsActionsTest-1225648455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4110df28-d17e-4ae2-b3f5-579c0912efda tempest-SnapshotsActionsTest-1225648455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:23 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-4110df28-d17e-4ae2-b3f5-579c0912efda tempest-SnapshotsActionsTest-1225648455 None] Creating offline snapshot b654a949-af8b-403a-b685-50f814bb1fd4 of volume e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 09:52:23 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc52109-3576-4210-8d1b-f175cf622ce7]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4110df28-d17e-4ae2-b3f5-579c0912efda tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:23 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 Jun 24 09:52:23 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:24 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4110df28-d17e-4ae2-b3f5-579c0912efda tempest-SnapshotsActionsTest-1225648455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972" returned: 0 in 0.990s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-4110df28-d17e-4ae2-b3f5-579c0912efda tempest-SnapshotsActionsTest-1225648455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:52:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4110df28-d17e-4ae2-b3f5-579c0912efda tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.b654a949-af8b-403a-b685-50f814bb1fd4 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:24 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.b654a949-af8b-403a-b685-50f814bb1fd4 1G Jun 24 09:52:24 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:24 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:52:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:52:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:52:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:25 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:52:25 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:25 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-66bf6c33-2959-4c00-a90f-3fb78401dc51 req-2c826575-074e-4483-9ec5-ab367a8626a1 tempest-AttachVolumeNegativeTest-2082640456 None] Terminate volume connection completed successfully. Jun 24 09:52:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-66bf6c33-2959-4c00-a90f-3fb78401dc51 req-2c826575-074e-4483-9ec5-ab367a8626a1 tempest-AttachVolumeNegativeTest-2082640456 None] Deleting attachment 549e1d89-9412-4d5d-9bf9-5695e131085a. {{(pid=93447) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 09:52:25 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4110df28-d17e-4ae2-b3f5-579c0912efda tempest-SnapshotsActionsTest-1225648455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.b654a949-af8b-403a-b685-50f814bb1fd4 1G" returned: 0 in 1.087s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4110df28-d17e-4ae2-b3f5-579c0912efda tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.b654a949-af8b-403a-b685-50f814bb1fd4 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:25 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.b654a949-af8b-403a-b685-50f814bb1fd4 Jun 24 09:52:25 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:25 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.851s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:52:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:52:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 8 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 09:52:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 09:52:26 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4110df28-d17e-4ae2-b3f5-579c0912efda tempest-SnapshotsActionsTest-1225648455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.b654a949-af8b-403a-b685-50f814bb1fd4" returned: 0 in 0.789s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:26 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-4110df28-d17e-4ae2-b3f5-579c0912efda tempest-SnapshotsActionsTest-1225648455 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.b654a949-af8b-403a-b685-50f814bb1fd4 is being set with open permissions: ugo+rw Jun 24 09:52:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4110df28-d17e-4ae2-b3f5-579c0912efda tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.b654a949-af8b-403a-b685-50f814bb1fd4 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:26 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.b654a949-af8b-403a-b685-50f814bb1fd4 Jun 24 09:52:26 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:26 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4110df28-d17e-4ae2-b3f5-579c0912efda tempest-SnapshotsActionsTest-1225648455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.b654a949-af8b-403a-b685-50f814bb1fd4" returned: 0 in 0.682s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4110df28-d17e-4ae2-b3f5-579c0912efda tempest-SnapshotsActionsTest-1225648455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.659s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:26 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-4110df28-d17e-4ae2-b3f5-579c0912efda tempest-SnapshotsActionsTest-1225648455 None] Create snapshot completed successfully Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-474c6f22-fab7-4c6a-81e4-b082031812cd tempest-SnapshotsActionsTest-1820002773 None] Acquiring lock "cinder-b654a949-af8b-403a-b685-50f814bb1fd4-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-474c6f22-fab7-4c6a-81e4-b082031812cd tempest-SnapshotsActionsTest-1820002773 None] Lock "cinder-b654a949-af8b-403a-b685-50f814bb1fd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-474c6f22-fab7-4c6a-81e4-b082031812cd tempest-SnapshotsActionsTest-1820002773 None] Acquiring lock "cinder-quobyte-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-474c6f22-fab7-4c6a-81e4-b082031812cd tempest-SnapshotsActionsTest-1820002773 None] Lock "cinder-quobyte-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-474c6f22-fab7-4c6a-81e4-b082031812cd tempest-SnapshotsActionsTest-1820002773 None] Acquiring lock "cinder-quobyte-b654a949-af8b-403a-b685-50f814bb1fd4" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-474c6f22-fab7-4c6a-81e4-b082031812cd tempest-SnapshotsActionsTest-1820002773 None] Lock "cinder-quobyte-b654a949-af8b-403a-b685-50f814bb1fd4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-474c6f22-fab7-4c6a-81e4-b082031812cd tempest-SnapshotsActionsTest-1820002773 None] Deleting offline snapshot b654a949-af8b-403a-b685-50f814bb1fd4 of volume e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-474c6f22-fab7-4c6a-81e4-b082031812cd tempest-SnapshotsActionsTest-1820002773 None] snapshot_file for this snap is: volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.b654a949-af8b-403a-b685-50f814bb1fd4 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce6242a-f832-41dc-b47d-01818333450c]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-474c6f22-fab7-4c6a-81e4-b082031812cd tempest-SnapshotsActionsTest-1820002773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.b654a949-af8b-403a-b685-50f814bb1fd4 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:27 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.b654a949-af8b-403a-b685-50f814bb1fd4 Jun 24 09:52:27 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Flow 'volume_create_manager' (f3bd0d00-d46c-43a4-8b73-b587028df9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efdf2e18-5b14-4fdd-8378-c2b19ff263a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efdf2e18-5b14-4fdd-8378-c2b19ff263a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-661144029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6149e50b-67c9-422c-9167-f9548ebf6306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a6d9f2868b4b9a82a5c0d0997a0448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:52:28Z,use_quota=True,user_id='2a05889cf72247bfbdfbf39dceefbbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b1def7b-bc80-4b76-9db0-75f63c065a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b1def7b-bc80-4b76-9db0-75f63c065a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ad5e5d-cfb4-4566-95fe-d7dac98f11bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ad5e5d-cfb4-4566-95fe-d7dac98f11bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6149e50b-67c9-422c-9167-f9548ebf6306', 'volume_name': 'volume-6149e50b-67c9-422c-9167-f9548ebf6306', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b95eaea4-065e-423a-9651-2858991f9986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b95eaea4-065e-423a-9651-2858991f9986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47edadf-5b3c-46b6-9f3e-cea7c0003f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:27 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Volume 6149e50b-67c9-422c-9167-f9548ebf6306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6149e50b-67c9-422c-9167-f9548ebf6306', 'volume_size': 1} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-661144029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6149e50b-67c9-422c-9167-f9548ebf6306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a6d9f2868b4b9a82a5c0d0997a0448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:52:28Z,use_quota=True,user_id='2a05889cf72247bfbdfbf39dceefbbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Creating volume 6149e50b-67c9-422c-9167-f9548ebf6306 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:52:27 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:52:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6149e50b-67c9-422c-9167-f9548ebf6306 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:27 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6149e50b-67c9-422c-9167-f9548ebf6306 1073741824 Jun 24 09:52:27 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:28 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-474c6f22-fab7-4c6a-81e4-b082031812cd tempest-SnapshotsActionsTest-1820002773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.b654a949-af8b-403a-b685-50f814bb1fd4" returned: 0 in 0.980s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:28 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-474c6f22-fab7-4c6a-81e4-b082031812cd tempest-SnapshotsActionsTest-1820002773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:52:28 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8985f71a-b2bc-49f2-a2d0-837135a4397d]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-474c6f22-fab7-4c6a-81e4-b082031812cd tempest-SnapshotsActionsTest-1820002773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:28 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 Jun 24 09:52:28 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:29 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6149e50b-67c9-422c-9167-f9548ebf6306 1073741824" returned: 0 in 1.201s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6149e50b-67c9-422c-9167-f9548ebf6306 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:29 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6149e50b-67c9-422c-9167-f9548ebf6306 Jun 24 09:52:29 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:29 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-474c6f22-fab7-4c6a-81e4-b082031812cd tempest-SnapshotsActionsTest-1820002773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972" returned: 0 in 0.973s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:29 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-474c6f22-fab7-4c6a-81e4-b082031812cd tempest-SnapshotsActionsTest-1820002773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:52:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-474c6f22-fab7-4c6a-81e4-b082031812cd tempest-SnapshotsActionsTest-1820002773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.b654a949-af8b-403a-b685-50f814bb1fd4 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:29 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.b654a949-af8b-403a-b685-50f814bb1fd4 Jun 24 09:52:29 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:29 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6149e50b-67c9-422c-9167-f9548ebf6306" returned: 0 in 0.720s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:29 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:52:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47edadf-5b3c-46b6-9f3e-cea7c0003f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6149e50b-67c9-422c-9167-f9548ebf6306', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be77b70-9ba6-479e-b2b3-fcabc1d229d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:29 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Volume volume-6149e50b-67c9-422c-9167-f9548ebf6306 (6149e50b-67c9-422c-9167-f9548ebf6306): created successfully Jun 24 09:52:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be77b70-9ba6-479e-b2b3-fcabc1d229d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Flow 'volume_create_manager' (f3bd0d00-d46c-43a4-8b73-b587028df9da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:52:30 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-ac2672f2-c30c-4395-b33f-da130d034136 tempest-AbsoluteLimitsTests-699172746 None] Created volume successfully. Jun 24 09:52:30 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-474c6f22-fab7-4c6a-81e4-b082031812cd tempest-SnapshotsActionsTest-1820002773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.b654a949-af8b-403a-b685-50f814bb1fd4" returned: 0 in 1.112s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-474c6f22-fab7-4c6a-81e4-b082031812cd tempest-SnapshotsActionsTest-1820002773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.b654a949-af8b-403a-b685-50f814bb1fd4 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:30 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.b654a949-af8b-403a-b685-50f814bb1fd4 Jun 24 09:52:30 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2a96f01e-379e-49f3-a29b-56e1ed409641 tempest-AbsoluteLimitsTests-699172746 None] Acquiring lock "cinder-6149e50b-67c9-422c-9167-f9548ebf6306-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2a96f01e-379e-49f3-a29b-56e1ed409641 tempest-AbsoluteLimitsTests-699172746 None] Lock "cinder-6149e50b-67c9-422c-9167-f9548ebf6306-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2a96f01e-379e-49f3-a29b-56e1ed409641 tempest-AbsoluteLimitsTests-699172746 None] Acquiring lock "cinder-quobyte-6149e50b-67c9-422c-9167-f9548ebf6306" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2a96f01e-379e-49f3-a29b-56e1ed409641 tempest-AbsoluteLimitsTests-699172746 None] Lock "cinder-quobyte-6149e50b-67c9-422c-9167-f9548ebf6306" acquired by "delete_volume" :: waited 0.016s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:31 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0310eab5-53d4-4b57-9e22-11fa82484a33]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2a96f01e-379e-49f3-a29b-56e1ed409641 tempest-AbsoluteLimitsTests-699172746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6149e50b-67c9-422c-9167-f9548ebf6306 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:31 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-474c6f22-fab7-4c6a-81e4-b082031812cd tempest-SnapshotsActionsTest-1820002773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.b654a949-af8b-403a-b685-50f814bb1fd4" returned: 0 in 1.007s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:31 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6149e50b-67c9-422c-9167-f9548ebf6306 Jun 24 09:52:31 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-474c6f22-fab7-4c6a-81e4-b082031812cd tempest-SnapshotsActionsTest-1820002773 None] Lock "cinder-quobyte-b654a949-af8b-403a-b685-50f814bb1fd4" released by "_delete_snapshot" :: held 4.204s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-474c6f22-fab7-4c6a-81e4-b082031812cd tempest-SnapshotsActionsTest-1820002773 None] Lock "cinder-quobyte-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585" released by "delete_snapshot" :: held 4.225s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:31 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-474c6f22-fab7-4c6a-81e4-b082031812cd tempest-SnapshotsActionsTest-1820002773 None] Created reservations ['c0b10115-e28a-49dc-a99f-561ae554c613', '3fa750ac-ac56-4075-91d9-6f44f67b7d7c', '3c513345-5956-46ba-8790-825a75e05f96', '1a018546-5940-4d5c-83ec-c5f42c71c48e'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:52:31 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-474c6f22-fab7-4c6a-81e4-b082031812cd tempest-SnapshotsActionsTest-1820002773 None] Delete snapshot completed successfully. Jun 24 09:52:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-474c6f22-fab7-4c6a-81e4-b082031812cd tempest-SnapshotsActionsTest-1820002773 None] Lock "cinder-b654a949-af8b-403a-b685-50f814bb1fd4-delete_snapshot" released by "delete_snapshot" :: held 4.373s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:32 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2a96f01e-379e-49f3-a29b-56e1ed409641 tempest-AbsoluteLimitsTests-699172746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6149e50b-67c9-422c-9167-f9548ebf6306" returned: 0 in 0.776s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2a96f01e-379e-49f3-a29b-56e1ed409641 tempest-AbsoluteLimitsTests-699172746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6149e50b-67c9-422c-9167-f9548ebf6306 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:32 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6149e50b-67c9-422c-9167-f9548ebf6306 Jun 24 09:52:32 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:32 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2a96f01e-379e-49f3-a29b-56e1ed409641 tempest-AbsoluteLimitsTests-699172746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6149e50b-67c9-422c-9167-f9548ebf6306" returned: 0 in 0.705s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:33 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2a96f01e-379e-49f3-a29b-56e1ed409641 tempest-AbsoluteLimitsTests-699172746 None] Lock "cinder-quobyte-6149e50b-67c9-422c-9167-f9548ebf6306" released by "delete_volume" :: held 1.532s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:33 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-2a96f01e-379e-49f3-a29b-56e1ed409641 tempest-AbsoluteLimitsTests-699172746 None] Created reservations ['e169ece0-e585-4e1e-affd-aba79a1bc3ab', '4b41350b-3349-4d33-a91b-83111e33ff2a', '92488e86-7cbf-41db-962c-b8a102f695cb', '6ea7712c-d97f-466b-9c09-78590ea05953'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:52:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2a96f01e-379e-49f3-a29b-56e1ed409641 tempest-AbsoluteLimitsTests-699172746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2a96f01e-379e-49f3-a29b-56e1ed409641 tempest-AbsoluteLimitsTests-699172746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2a96f01e-379e-49f3-a29b-56e1ed409641 tempest-AbsoluteLimitsTests-699172746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:52:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2a96f01e-379e-49f3-a29b-56e1ed409641 tempest-AbsoluteLimitsTests-699172746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:52:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2a96f01e-379e-49f3-a29b-56e1ed409641 tempest-AbsoluteLimitsTests-699172746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2a96f01e-379e-49f3-a29b-56e1ed409641 tempest-AbsoluteLimitsTests-699172746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:33 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:52:33 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:33 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-849d518f-b7b1-40cc-94cc-10629c7a9759 tempest-SnapshotsActionsTest-1225648455 None] Acquiring lock "cinder-68a05b99-e069-4f94-bbc1-4097278f9972-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:33 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-849d518f-b7b1-40cc-94cc-10629c7a9759 tempest-SnapshotsActionsTest-1225648455 None] Lock "cinder-68a05b99-e069-4f94-bbc1-4097278f9972-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:33 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-849d518f-b7b1-40cc-94cc-10629c7a9759 tempest-SnapshotsActionsTest-1225648455 None] Acquiring lock "cinder-quobyte-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:33 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-849d518f-b7b1-40cc-94cc-10629c7a9759 tempest-SnapshotsActionsTest-1225648455 None] Lock "cinder-quobyte-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:33 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-849d518f-b7b1-40cc-94cc-10629c7a9759 tempest-SnapshotsActionsTest-1225648455 None] Acquiring lock "cinder-quobyte-68a05b99-e069-4f94-bbc1-4097278f9972" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:33 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-849d518f-b7b1-40cc-94cc-10629c7a9759 tempest-SnapshotsActionsTest-1225648455 None] Lock "cinder-quobyte-68a05b99-e069-4f94-bbc1-4097278f9972" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-849d518f-b7b1-40cc-94cc-10629c7a9759 tempest-SnapshotsActionsTest-1225648455 None] Deleting offline snapshot 68a05b99-e069-4f94-bbc1-4097278f9972 of volume e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 09:52:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-849d518f-b7b1-40cc-94cc-10629c7a9759 tempest-SnapshotsActionsTest-1225648455 None] snapshot_file for this snap is: volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 09:52:33 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d86e3be-489e-412d-9718-8bbd7e2dc81d]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-849d518f-b7b1-40cc-94cc-10629c7a9759 tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:33 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 Jun 24 09:52:33 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:33 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2a96f01e-379e-49f3-a29b-56e1ed409641 tempest-AbsoluteLimitsTests-699172746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.768s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:33 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2a96f01e-379e-49f3-a29b-56e1ed409641 tempest-AbsoluteLimitsTests-699172746 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:52:33 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-2a96f01e-379e-49f3-a29b-56e1ed409641 tempest-AbsoluteLimitsTests-699172746 None] Deleted volume successfully. Jun 24 09:52:33 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2a96f01e-379e-49f3-a29b-56e1ed409641 tempest-AbsoluteLimitsTests-699172746 None] Lock "cinder-6149e50b-67c9-422c-9167-f9548ebf6306-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:34 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-849d518f-b7b1-40cc-94cc-10629c7a9759 tempest-SnapshotsActionsTest-1225648455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972" returned: 0 in 0.993s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:34 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-849d518f-b7b1-40cc-94cc-10629c7a9759 tempest-SnapshotsActionsTest-1225648455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:52:34 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[656a71df-271b-4b24-9a1f-bfd584c3e36b]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-849d518f-b7b1-40cc-94cc-10629c7a9759 tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:34 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 Jun 24 09:52:34 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:35 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-849d518f-b7b1-40cc-94cc-10629c7a9759 tempest-SnapshotsActionsTest-1225648455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585" returned: 0 in 1.330s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-849d518f-b7b1-40cc-94cc-10629c7a9759 tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:35 devstack sudo[102563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 Jun 24 09:52:35 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:37 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-849d518f-b7b1-40cc-94cc-10629c7a9759 tempest-SnapshotsActionsTest-1225648455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972" returned: 0 in 1.534s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-849d518f-b7b1-40cc-94cc-10629c7a9759 tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:37 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972 Jun 24 09:52:37 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:37 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-aa5f764a-795d-4b8d-8dc7-a0941d9cb031 tempest-AttachVolumeNegativeTest-2082640456 None] Acquiring lock "cinder-20d302b6-8ece-4e1c-90a9-dbdc2839dbda-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:37 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-aa5f764a-795d-4b8d-8dc7-a0941d9cb031 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "cinder-20d302b6-8ece-4e1c-90a9-dbdc2839dbda-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:37 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-aa5f764a-795d-4b8d-8dc7-a0941d9cb031 tempest-AttachVolumeNegativeTest-2082640456 None] Acquiring lock "cinder-quobyte-20d302b6-8ece-4e1c-90a9-dbdc2839dbda" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:37 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-aa5f764a-795d-4b8d-8dc7-a0941d9cb031 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "cinder-quobyte-20d302b6-8ece-4e1c-90a9-dbdc2839dbda" acquired by "delete_volume" :: waited 0.021s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:37 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6692af4-e6c1-425e-a085-f0de4d529055]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-aa5f764a-795d-4b8d-8dc7-a0941d9cb031 tempest-AttachVolumeNegativeTest-2082640456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-20d302b6-8ece-4e1c-90a9-dbdc2839dbda {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:37 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-20d302b6-8ece-4e1c-90a9-dbdc2839dbda Jun 24 09:52:37 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:38 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-849d518f-b7b1-40cc-94cc-10629c7a9759 tempest-SnapshotsActionsTest-1225648455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585.68a05b99-e069-4f94-bbc1-4097278f9972" returned: 0 in 1.239s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:38 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-849d518f-b7b1-40cc-94cc-10629c7a9759 tempest-SnapshotsActionsTest-1225648455 None] Lock "cinder-quobyte-68a05b99-e069-4f94-bbc1-4097278f9972" released by "_delete_snapshot" :: held 5.230s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:38 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-849d518f-b7b1-40cc-94cc-10629c7a9759 tempest-SnapshotsActionsTest-1225648455 None] Lock "cinder-quobyte-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585" released by "delete_snapshot" :: held 5.254s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:38 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-849d518f-b7b1-40cc-94cc-10629c7a9759 tempest-SnapshotsActionsTest-1225648455 None] Created reservations ['a91c4051-42f6-4086-a835-065d7e678c8c', 'a7902208-d55e-4ba9-ad61-9db54da09312', '03bfc0e2-ed7e-42a6-871c-af8d255b67e0', '4b4dff97-ebc8-45a9-bfef-43889af20587'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:52:38 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-849d518f-b7b1-40cc-94cc-10629c7a9759 tempest-SnapshotsActionsTest-1225648455 None] Delete snapshot completed successfully. Jun 24 09:52:38 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-849d518f-b7b1-40cc-94cc-10629c7a9759 tempest-SnapshotsActionsTest-1225648455 None] Lock "cinder-68a05b99-e069-4f94-bbc1-4097278f9972-delete_snapshot" released by "delete_snapshot" :: held 5.487s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:38 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-aa5f764a-795d-4b8d-8dc7-a0941d9cb031 tempest-AttachVolumeNegativeTest-2082640456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-20d302b6-8ece-4e1c-90a9-dbdc2839dbda" returned: 0 in 1.181s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-aa5f764a-795d-4b8d-8dc7-a0941d9cb031 tempest-AttachVolumeNegativeTest-2082640456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-20d302b6-8ece-4e1c-90a9-dbdc2839dbda {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:38 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-20d302b6-8ece-4e1c-90a9-dbdc2839dbda Jun 24 09:52:38 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:39 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-aa5f764a-795d-4b8d-8dc7-a0941d9cb031 tempest-AttachVolumeNegativeTest-2082640456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-20d302b6-8ece-4e1c-90a9-dbdc2839dbda" returned: 0 in 0.776s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-aa5f764a-795d-4b8d-8dc7-a0941d9cb031 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "cinder-quobyte-20d302b6-8ece-4e1c-90a9-dbdc2839dbda" released by "delete_volume" :: held 2.022s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:39 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-aa5f764a-795d-4b8d-8dc7-a0941d9cb031 tempest-AttachVolumeNegativeTest-2082640456 None] Created reservations ['05a8742d-2887-4583-a1d5-b9330558ccfb', '579428d4-b3e8-435e-9b61-5f19b7294a62', '445af3ea-e7e0-4192-99c3-949d91c5a8ac', 'da7903d3-faf6-420c-b286-279c172222bc'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:52:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-aa5f764a-795d-4b8d-8dc7-a0941d9cb031 tempest-AttachVolumeNegativeTest-2082640456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-aa5f764a-795d-4b8d-8dc7-a0941d9cb031 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-aa5f764a-795d-4b8d-8dc7-a0941d9cb031 tempest-AttachVolumeNegativeTest-2082640456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:52:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-aa5f764a-795d-4b8d-8dc7-a0941d9cb031 tempest-AttachVolumeNegativeTest-2082640456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:52:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-aa5f764a-795d-4b8d-8dc7-a0941d9cb031 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-aa5f764a-795d-4b8d-8dc7-a0941d9cb031 tempest-AttachVolumeNegativeTest-2082640456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:39 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:52:39 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ceff2ab6-932a-48df-8119-873bf773f91e tempest-SnapshotsActionsTest-1225648455 None] Acquiring lock "cinder-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ceff2ab6-932a-48df-8119-873bf773f91e tempest-SnapshotsActionsTest-1225648455 None] Lock "cinder-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ceff2ab6-932a-48df-8119-873bf773f91e tempest-SnapshotsActionsTest-1225648455 None] Acquiring lock "cinder-quobyte-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ceff2ab6-932a-48df-8119-873bf773f91e tempest-SnapshotsActionsTest-1225648455 None] Lock "cinder-quobyte-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585" acquired by "delete_volume" :: waited 0.044s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a58c367c-c78d-4e5b-a6a3-09cb22a60035 tempest-AttachVolumeNegativeTest-2082640456 None] Acquiring lock "cinder-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:40 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8d523c-8736-4e2b-b7ec-5ae3a99babb0]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ceff2ab6-932a-48df-8119-873bf773f91e tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a58c367c-c78d-4e5b-a6a3-09cb22a60035 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "cinder-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a58c367c-c78d-4e5b-a6a3-09cb22a60035 tempest-AttachVolumeNegativeTest-2082640456 None] Acquiring lock "cinder-quobyte-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a58c367c-c78d-4e5b-a6a3-09cb22a60035 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "cinder-quobyte-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd" acquired by "delete_volume" :: waited 0.037s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:40 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 Jun 24 09:52:40 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:40 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7f2bb2-af68-4be8-8580-e25176cb9748]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a58c367c-c78d-4e5b-a6a3-09cb22a60035 tempest-AttachVolumeNegativeTest-2082640456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:40 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd Jun 24 09:52:40 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:40 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-aa5f764a-795d-4b8d-8dc7-a0941d9cb031 tempest-AttachVolumeNegativeTest-2082640456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.980s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:40 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-aa5f764a-795d-4b8d-8dc7-a0941d9cb031 tempest-AttachVolumeNegativeTest-2082640456 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:52:40 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-aa5f764a-795d-4b8d-8dc7-a0941d9cb031 tempest-AttachVolumeNegativeTest-2082640456 None] Deleted volume successfully. Jun 24 09:52:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-aa5f764a-795d-4b8d-8dc7-a0941d9cb031 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "cinder-20d302b6-8ece-4e1c-90a9-dbdc2839dbda-delete_volume" released by "delete_volume" :: held 3.339s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:41 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ceff2ab6-932a-48df-8119-873bf773f91e tempest-SnapshotsActionsTest-1225648455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585" returned: 0 in 1.061s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ceff2ab6-932a-48df-8119-873bf773f91e tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:41 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585 Jun 24 09:52:41 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:41 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a58c367c-c78d-4e5b-a6a3-09cb22a60035 tempest-AttachVolumeNegativeTest-2082640456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd" returned: 0 in 1.098s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a58c367c-c78d-4e5b-a6a3-09cb22a60035 tempest-AttachVolumeNegativeTest-2082640456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:41 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd Jun 24 09:52:41 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:42 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ceff2ab6-932a-48df-8119-873bf773f91e tempest-SnapshotsActionsTest-1225648455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585" returned: 0 in 0.801s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ceff2ab6-932a-48df-8119-873bf773f91e tempest-SnapshotsActionsTest-1225648455 None] Lock "cinder-quobyte-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585" released by "delete_volume" :: held 1.993s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-ceff2ab6-932a-48df-8119-873bf773f91e tempest-SnapshotsActionsTest-1225648455 None] Created reservations ['db7b3f3d-4fb1-4c8c-9943-320d5e8a556c', '48141948-07bd-4977-80de-97f6ad9ca7c2', '4203e0d8-5a89-4048-84c0-c9137f67475f', '05782b69-cee2-45ec-92f8-a5d720771f9a'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:52:42 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a58c367c-c78d-4e5b-a6a3-09cb22a60035 tempest-AttachVolumeNegativeTest-2082640456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd" returned: 0 in 0.747s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a58c367c-c78d-4e5b-a6a3-09cb22a60035 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "cinder-quobyte-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd" released by "delete_volume" :: held 1.925s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ceff2ab6-932a-48df-8119-873bf773f91e tempest-SnapshotsActionsTest-1225648455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ceff2ab6-932a-48df-8119-873bf773f91e tempest-SnapshotsActionsTest-1225648455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ceff2ab6-932a-48df-8119-873bf773f91e tempest-SnapshotsActionsTest-1225648455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ceff2ab6-932a-48df-8119-873bf773f91e tempest-SnapshotsActionsTest-1225648455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ceff2ab6-932a-48df-8119-873bf773f91e tempest-SnapshotsActionsTest-1225648455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ceff2ab6-932a-48df-8119-873bf773f91e tempest-SnapshotsActionsTest-1225648455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-a58c367c-c78d-4e5b-a6a3-09cb22a60035 tempest-AttachVolumeNegativeTest-2082640456 None] Created reservations ['f955ea26-416e-4723-b254-c9eb0defe97e', '6c5d9942-ed56-4fbb-a617-85aede64cbc7', 'cf209676-335f-4775-befe-8dd6dbcfe34a', '279ee597-9a0d-47f7-9824-6d9166db2898'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:52:42 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:52:42 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a58c367c-c78d-4e5b-a6a3-09cb22a60035 tempest-AttachVolumeNegativeTest-2082640456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a58c367c-c78d-4e5b-a6a3-09cb22a60035 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a58c367c-c78d-4e5b-a6a3-09cb22a60035 tempest-AttachVolumeNegativeTest-2082640456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a58c367c-c78d-4e5b-a6a3-09cb22a60035 tempest-AttachVolumeNegativeTest-2082640456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a58c367c-c78d-4e5b-a6a3-09cb22a60035 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a58c367c-c78d-4e5b-a6a3-09cb22a60035 tempest-AttachVolumeNegativeTest-2082640456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:42 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:52:42 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Flow 'volume_create_manager' (39055ed4-e3f1-4dc1-8a2d-27c0f4e81825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1798d0c9-ceec-4dd6-b426-089afa5379ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1798d0c9-ceec-4dd6-b426-089afa5379ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-528962027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c49bd38-cc84-43c5-959c-9b8c76a163e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adb620c9c5d04a6c8976844d25450020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:52:43Z,use_quota=True,user_id='c1cbba02473e455f95116fd26230b1f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (192d3120-6d9d-4517-a62e-0ae5707ed95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (192d3120-6d9d-4517-a62e-0ae5707ed95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4266624a-2ebd-4776-b59e-cf218e9a5766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4266624a-2ebd-4776-b59e-cf218e9a5766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c49bd38-cc84-43c5-959c-9b8c76a163e3', 'volume_name': 'volume-7c49bd38-cc84-43c5-959c-9b8c76a163e3', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (852649e3-459d-46f1-8b2a-ebe9b508ac64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (852649e3-459d-46f1-8b2a-ebe9b508ac64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec414f3-024d-466f-a444-725e4bfd6b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:42 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Volume 7c49bd38-cc84-43c5-959c-9b8c76a163e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c49bd38-cc84-43c5-959c-9b8c76a163e3', 'volume_size': 1} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-528962027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c49bd38-cc84-43c5-959c-9b8c76a163e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adb620c9c5d04a6c8976844d25450020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:52:43Z,use_quota=True,user_id='c1cbba02473e455f95116fd26230b1f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Creating volume 7c49bd38-cc84-43c5-959c-9b8c76a163e3 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:52:42 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:52:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c49bd38-cc84-43c5-959c-9b8c76a163e3 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:42 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c49bd38-cc84-43c5-959c-9b8c76a163e3 1073741824 Jun 24 09:52:42 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:43 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ceff2ab6-932a-48df-8119-873bf773f91e tempest-SnapshotsActionsTest-1225648455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.798s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:43 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-ceff2ab6-932a-48df-8119-873bf773f91e tempest-SnapshotsActionsTest-1225648455 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:52:43 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-ceff2ab6-932a-48df-8119-873bf773f91e tempest-SnapshotsActionsTest-1225648455 None] Deleted volume successfully. Jun 24 09:52:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ceff2ab6-932a-48df-8119-873bf773f91e tempest-SnapshotsActionsTest-1225648455 None] Lock "cinder-e39960d9-67c6-4a8c-b81d-3ee0f5fcd585-delete_volume" released by "delete_volume" :: held 3.188s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:43 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a58c367c-c78d-4e5b-a6a3-09cb22a60035 tempest-AttachVolumeNegativeTest-2082640456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.812s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:43 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-a58c367c-c78d-4e5b-a6a3-09cb22a60035 tempest-AttachVolumeNegativeTest-2082640456 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:52:43 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-a58c367c-c78d-4e5b-a6a3-09cb22a60035 tempest-AttachVolumeNegativeTest-2082640456 None] Deleted volume successfully. Jun 24 09:52:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a58c367c-c78d-4e5b-a6a3-09cb22a60035 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "cinder-3bec2754-f89f-4dc7-a6d4-f7cba550a5fd-delete_volume" released by "delete_volume" :: held 3.181s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:43 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c49bd38-cc84-43c5-959c-9b8c76a163e3 1073741824" returned: 0 in 0.993s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c49bd38-cc84-43c5-959c-9b8c76a163e3 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:43 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c49bd38-cc84-43c5-959c-9b8c76a163e3 Jun 24 09:52:43 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-deda0c26-9e5c-414a-a052-12a84980cca0 tempest-AttachVolumeNegativeTest-2082640456 None] Acquiring lock "cinder-deb945e4-7fc2-4965-8b00-a4d7dce202ce-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-deda0c26-9e5c-414a-a052-12a84980cca0 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "cinder-deb945e4-7fc2-4965-8b00-a4d7dce202ce-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-deda0c26-9e5c-414a-a052-12a84980cca0 tempest-AttachVolumeNegativeTest-2082640456 None] Acquiring lock "cinder-quobyte-deb945e4-7fc2-4965-8b00-a4d7dce202ce" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-deda0c26-9e5c-414a-a052-12a84980cca0 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "cinder-quobyte-deb945e4-7fc2-4965-8b00-a4d7dce202ce" acquired by "delete_volume" :: waited 0.016s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:43 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7528a6-9ede-4b76-82b2-f9a527b1f69f]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-deda0c26-9e5c-414a-a052-12a84980cca0 tempest-AttachVolumeNegativeTest-2082640456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-deb945e4-7fc2-4965-8b00-a4d7dce202ce {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:44 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-deb945e4-7fc2-4965-8b00-a4d7dce202ce Jun 24 09:52:44 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:44 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c49bd38-cc84-43c5-959c-9b8c76a163e3" returned: 0 in 0.893s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:52:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.937s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec414f3-024d-466f-a444-725e4bfd6b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c49bd38-cc84-43c5-959c-9b8c76a163e3', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10479889-7fb0-4036-be92-804dffa314e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:44 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Volume volume-7c49bd38-cc84-43c5-959c-9b8c76a163e3 (7c49bd38-cc84-43c5-959c-9b8c76a163e3): created successfully Jun 24 09:52:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10479889-7fb0-4036-be92-804dffa314e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Flow 'volume_create_manager' (39055ed4-e3f1-4dc1-8a2d-27c0f4e81825) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:52:44 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-0061f435-1d90-4fec-9e2c-7e9d25bd6f23 tempest-VolumesTransfersTest-385551456 None] Created volume successfully. Jun 24 09:52:45 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-deda0c26-9e5c-414a-a052-12a84980cca0 tempest-AttachVolumeNegativeTest-2082640456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-deb945e4-7fc2-4965-8b00-a4d7dce202ce" returned: 0 in 1.080s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-deda0c26-9e5c-414a-a052-12a84980cca0 tempest-AttachVolumeNegativeTest-2082640456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-deb945e4-7fc2-4965-8b00-a4d7dce202ce {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:45 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-deb945e4-7fc2-4965-8b00-a4d7dce202ce Jun 24 09:52:45 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:45 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-deda0c26-9e5c-414a-a052-12a84980cca0 tempest-AttachVolumeNegativeTest-2082640456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-deb945e4-7fc2-4965-8b00-a4d7dce202ce" returned: 0 in 0.792s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-deda0c26-9e5c-414a-a052-12a84980cca0 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "cinder-quobyte-deb945e4-7fc2-4965-8b00-a4d7dce202ce" released by "delete_volume" :: held 1.965s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:46 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-deda0c26-9e5c-414a-a052-12a84980cca0 tempest-AttachVolumeNegativeTest-2082640456 None] Created reservations ['0d14cbbb-56f2-4f35-802c-d2e4f4ed1fc3', '0fa32d23-dea2-48b2-8041-f9ff96e7abe6', '818ef44d-2d1c-4196-8754-88eb60375924', '6be2fb29-2600-4e59-86ff-5c3e0d62b795'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:52:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-deda0c26-9e5c-414a-a052-12a84980cca0 tempest-AttachVolumeNegativeTest-2082640456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-deda0c26-9e5c-414a-a052-12a84980cca0 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-deda0c26-9e5c-414a-a052-12a84980cca0 tempest-AttachVolumeNegativeTest-2082640456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:52:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-deda0c26-9e5c-414a-a052-12a84980cca0 tempest-AttachVolumeNegativeTest-2082640456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:52:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-deda0c26-9e5c-414a-a052-12a84980cca0 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-deda0c26-9e5c-414a-a052-12a84980cca0 tempest-AttachVolumeNegativeTest-2082640456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:46 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:52:46 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:47 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-c6fd4a49-381d-43ee-9d4c-9b89e65c2ceb tempest-VolumesTransfersTest-285989657 None] Transfer volume completed successfully. Jun 24 09:52:47 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-deda0c26-9e5c-414a-a052-12a84980cca0 tempest-AttachVolumeNegativeTest-2082640456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.130s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:47 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-deda0c26-9e5c-414a-a052-12a84980cca0 tempest-AttachVolumeNegativeTest-2082640456 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:52:47 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-deda0c26-9e5c-414a-a052-12a84980cca0 tempest-AttachVolumeNegativeTest-2082640456 None] Deleted volume successfully. Jun 24 09:52:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-deda0c26-9e5c-414a-a052-12a84980cca0 tempest-AttachVolumeNegativeTest-2082640456 None] Lock "cinder-deb945e4-7fc2-4965-8b00-a4d7dce202ce-delete_volume" released by "delete_volume" :: held 3.409s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0242b1f6-3eae-412a-bfe3-1546b2750ea5 tempest-VolumesTransfersTest-1081445498 None] Acquiring lock "cinder-7c49bd38-cc84-43c5-959c-9b8c76a163e3-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0242b1f6-3eae-412a-bfe3-1546b2750ea5 tempest-VolumesTransfersTest-1081445498 None] Lock "cinder-7c49bd38-cc84-43c5-959c-9b8c76a163e3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0242b1f6-3eae-412a-bfe3-1546b2750ea5 tempest-VolumesTransfersTest-1081445498 None] Acquiring lock "cinder-quobyte-7c49bd38-cc84-43c5-959c-9b8c76a163e3" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0242b1f6-3eae-412a-bfe3-1546b2750ea5 tempest-VolumesTransfersTest-1081445498 None] Lock "cinder-quobyte-7c49bd38-cc84-43c5-959c-9b8c76a163e3" acquired by "delete_volume" :: waited 0.017s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:48 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40236ad-13ad-450b-9100-e8a20c783c5c]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0242b1f6-3eae-412a-bfe3-1546b2750ea5 tempest-VolumesTransfersTest-1081445498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c49bd38-cc84-43c5-959c-9b8c76a163e3 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:48 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c49bd38-cc84-43c5-959c-9b8c76a163e3 Jun 24 09:52:48 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:49 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0242b1f6-3eae-412a-bfe3-1546b2750ea5 tempest-VolumesTransfersTest-1081445498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c49bd38-cc84-43c5-959c-9b8c76a163e3" returned: 0 in 0.872s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0242b1f6-3eae-412a-bfe3-1546b2750ea5 tempest-VolumesTransfersTest-1081445498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c49bd38-cc84-43c5-959c-9b8c76a163e3 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:49 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c49bd38-cc84-43c5-959c-9b8c76a163e3 Jun 24 09:52:49 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:50 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0242b1f6-3eae-412a-bfe3-1546b2750ea5 tempest-VolumesTransfersTest-1081445498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c49bd38-cc84-43c5-959c-9b8c76a163e3" returned: 0 in 0.763s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0242b1f6-3eae-412a-bfe3-1546b2750ea5 tempest-VolumesTransfersTest-1081445498 None] Lock "cinder-quobyte-7c49bd38-cc84-43c5-959c-9b8c76a163e3" released by "delete_volume" :: held 1.710s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:50 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-0242b1f6-3eae-412a-bfe3-1546b2750ea5 tempest-VolumesTransfersTest-1081445498 None] Created reservations ['4136eb6f-5b8f-48ba-9e90-895a664625ae', '57b93dd1-d326-4804-8795-a9950f844319', 'da1ddc44-f829-4fe2-b811-a6959dfc5ec5', 'f593bade-b35b-4018-875e-a29d7cc769ba'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:52:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0242b1f6-3eae-412a-bfe3-1546b2750ea5 tempest-VolumesTransfersTest-1081445498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0242b1f6-3eae-412a-bfe3-1546b2750ea5 tempest-VolumesTransfersTest-1081445498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0242b1f6-3eae-412a-bfe3-1546b2750ea5 tempest-VolumesTransfersTest-1081445498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:52:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0242b1f6-3eae-412a-bfe3-1546b2750ea5 tempest-VolumesTransfersTest-1081445498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:52:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0242b1f6-3eae-412a-bfe3-1546b2750ea5 tempest-VolumesTransfersTest-1081445498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0242b1f6-3eae-412a-bfe3-1546b2750ea5 tempest-VolumesTransfersTest-1081445498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:50 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:52:50 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:51 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0242b1f6-3eae-412a-bfe3-1546b2750ea5 tempest-VolumesTransfersTest-1081445498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.782s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-0242b1f6-3eae-412a-bfe3-1546b2750ea5 tempest-VolumesTransfersTest-1081445498 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:52:51 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-0242b1f6-3eae-412a-bfe3-1546b2750ea5 tempest-VolumesTransfersTest-1081445498 None] Deleted volume successfully. Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0242b1f6-3eae-412a-bfe3-1546b2750ea5 tempest-VolumesTransfersTest-1081445498 None] Lock "cinder-7c49bd38-cc84-43c5-959c-9b8c76a163e3-delete_volume" released by "delete_volume" :: held 2.751s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Flow 'volume_create_manager' (6747b245-e159-4a60-86ba-2799733f51bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82276bff-0d68-4f18-9852-6f02c1c90d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82276bff-0d68-4f18-9852-6f02c1c90d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1277756943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f56e38b-134d-4913-a242-8f77925a2b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adb620c9c5d04a6c8976844d25450020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:52:52Z,use_quota=True,user_id='c1cbba02473e455f95116fd26230b1f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e045003-52aa-41f3-a522-8c7fb32673d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e045003-52aa-41f3-a522-8c7fb32673d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b467b43-c8ef-4561-88d8-61d1b4a31b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b467b43-c8ef-4561-88d8-61d1b4a31b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f56e38b-134d-4913-a242-8f77925a2b04', 'volume_name': 'volume-2f56e38b-134d-4913-a242-8f77925a2b04', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca8a789-05c9-4ea9-9e15-7ac85dc9a6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca8a789-05c9-4ea9-9e15-7ac85dc9a6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (122d84f2-2268-4164-aae9-6e9ecc11a1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:51 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Volume 2f56e38b-134d-4913-a242-8f77925a2b04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f56e38b-134d-4913-a242-8f77925a2b04', 'volume_size': 1} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1277756943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f56e38b-134d-4913-a242-8f77925a2b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adb620c9c5d04a6c8976844d25450020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:52:52Z,use_quota=True,user_id='c1cbba02473e455f95116fd26230b1f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Creating volume 2f56e38b-134d-4913-a242-8f77925a2b04 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:52:51 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2f56e38b-134d-4913-a242-8f77925a2b04 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:51 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2f56e38b-134d-4913-a242-8f77925a2b04 1073741824 Jun 24 09:52:51 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Flow 'volume_create_manager' (6fe4c6b9-fa0f-42cb-a563-bdb022da8799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0227abe3-bf28-4b83-99ab-a16bf9d14360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0227abe3-bf28-4b83-99ab-a16bf9d14360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1607727028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3911ed-1507-46d4-9dce-b34721c5849a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f5903f31ec48a8a6400b6f905d92dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:52:52Z,use_quota=True,user_id='e68081b235d840b7a9e2d2f379deba94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78eb5ae-a31e-4542-8826-b9dd1da8ba32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78eb5ae-a31e-4542-8826-b9dd1da8ba32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7e6cd3-5c84-4133-83f2-17c18a65e92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7e6cd3-5c84-4133-83f2-17c18a65e92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a3911ed-1507-46d4-9dce-b34721c5849a', 'volume_name': 'volume-9a3911ed-1507-46d4-9dce-b34721c5849a', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1286944b-283e-4902-a006-9fc1d5a461d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1286944b-283e-4902-a006-9fc1d5a461d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66203de5-3d0d-4c38-b9e6-754733d5b452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:51 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Volume 9a3911ed-1507-46d4-9dce-b34721c5849a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a3911ed-1507-46d4-9dce-b34721c5849a', 'volume_size': 1} Jun 24 09:52:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:52 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2f56e38b-134d-4913-a242-8f77925a2b04 1073741824" returned: 0 in 0.911s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2f56e38b-134d-4913-a242-8f77925a2b04 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:52 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2f56e38b-134d-4913-a242-8f77925a2b04 Jun 24 09:52:52 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:53 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2f56e38b-134d-4913-a242-8f77925a2b04" returned: 0 in 0.636s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:52:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.431s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1607727028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3911ed-1507-46d4-9dce-b34721c5849a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f5903f31ec48a8a6400b6f905d92dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:52:52Z,use_quota=True,user_id='e68081b235d840b7a9e2d2f379deba94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:52:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Creating volume 9a3911ed-1507-46d4-9dce-b34721c5849a {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:52:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:52:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:52:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:52:53 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:52:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9a3911ed-1507-46d4-9dce-b34721c5849a 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (122d84f2-2268-4164-aae9-6e9ecc11a1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f56e38b-134d-4913-a242-8f77925a2b04', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:53 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9a3911ed-1507-46d4-9dce-b34721c5849a 1073741824 Jun 24 09:52:53 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d01bd7-a6fd-415d-8185-634baedb2a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:53 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Volume volume-2f56e38b-134d-4913-a242-8f77925a2b04 (2f56e38b-134d-4913-a242-8f77925a2b04): created successfully Jun 24 09:52:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d01bd7-a6fd-415d-8185-634baedb2a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Flow 'volume_create_manager' (6747b245-e159-4a60-86ba-2799733f51bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:52:53 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-58e5be8c-6fcb-4d5b-ba17-c9262012969b tempest-VolumesTransfersTest-385551456 None] Created volume successfully. Jun 24 09:52:54 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5c52ae6a-2706-4e85-8aec-245526fc7d21 tempest-VolumesTransfersTest-1081445498 None] Acquiring lock "cinder-2f56e38b-134d-4913-a242-8f77925a2b04-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:54 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5c52ae6a-2706-4e85-8aec-245526fc7d21 tempest-VolumesTransfersTest-1081445498 None] Lock "cinder-2f56e38b-134d-4913-a242-8f77925a2b04-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:54 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5c52ae6a-2706-4e85-8aec-245526fc7d21 tempest-VolumesTransfersTest-1081445498 None] Acquiring lock "cinder-quobyte-2f56e38b-134d-4913-a242-8f77925a2b04" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:54 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5c52ae6a-2706-4e85-8aec-245526fc7d21 tempest-VolumesTransfersTest-1081445498 None] Lock "cinder-quobyte-2f56e38b-134d-4913-a242-8f77925a2b04" acquired by "delete_volume" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:54 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fc77f9-5739-4cbb-bed9-ca8c3beecac2]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5c52ae6a-2706-4e85-8aec-245526fc7d21 tempest-VolumesTransfersTest-1081445498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2f56e38b-134d-4913-a242-8f77925a2b04 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:54 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2f56e38b-134d-4913-a242-8f77925a2b04 Jun 24 09:52:54 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:54 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9a3911ed-1507-46d4-9dce-b34721c5849a 1073741824" returned: 0 in 0.989s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9a3911ed-1507-46d4-9dce-b34721c5849a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:54 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9a3911ed-1507-46d4-9dce-b34721c5849a Jun 24 09:52:54 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:55 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-df97e3d2-0a17-4c9a-87f1-52227f9f8f45 tempest-GroupSnapshotsTest-344279173 None] Group tempest-GroupSnapshotsTest-Group-1278032000: creating Jun 24 09:52:55 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-df97e3d2-0a17-4c9a-87f1-52227f9f8f45 tempest-GroupSnapshotsTest-344279173 None] Group tempest-GroupSnapshotsTest-Group-1278032000: created successfully Jun 24 09:52:55 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-df97e3d2-0a17-4c9a-87f1-52227f9f8f45 tempest-GroupSnapshotsTest-344279173 None] Create group completed successfully. Jun 24 09:52:55 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5c52ae6a-2706-4e85-8aec-245526fc7d21 tempest-VolumesTransfersTest-1081445498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2f56e38b-134d-4913-a242-8f77925a2b04" returned: 0 in 0.990s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5c52ae6a-2706-4e85-8aec-245526fc7d21 tempest-VolumesTransfersTest-1081445498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2f56e38b-134d-4913-a242-8f77925a2b04 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:55 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2f56e38b-134d-4913-a242-8f77925a2b04 Jun 24 09:52:55 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:55 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9a3911ed-1507-46d4-9dce-b34721c5849a" returned: 0 in 0.818s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:55 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:52:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:55 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66203de5-3d0d-4c38-b9e6-754733d5b452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a3911ed-1507-46d4-9dce-b34721c5849a', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:55 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee351bba-e5dd-4aa4-bbf1-c520f3abd9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:55 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Volume volume-9a3911ed-1507-46d4-9dce-b34721c5849a (9a3911ed-1507-46d4-9dce-b34721c5849a): created successfully Jun 24 09:52:55 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee351bba-e5dd-4aa4-bbf1-c520f3abd9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:55 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Flow 'volume_create_manager' (6fe4c6b9-fa0f-42cb-a563-bdb022da8799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:52:55 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-e1a98573-9f62-4632-bc7a-3521d5481571 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Created volume successfully. Jun 24 09:52:55 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5c52ae6a-2706-4e85-8aec-245526fc7d21 tempest-VolumesTransfersTest-1081445498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2f56e38b-134d-4913-a242-8f77925a2b04" returned: 0 in 0.726s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:55 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5c52ae6a-2706-4e85-8aec-245526fc7d21 tempest-VolumesTransfersTest-1081445498 None] Lock "cinder-quobyte-2f56e38b-134d-4913-a242-8f77925a2b04" released by "delete_volume" :: held 1.766s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:56 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-5c52ae6a-2706-4e85-8aec-245526fc7d21 tempest-VolumesTransfersTest-1081445498 None] Created reservations ['779e93dd-629c-404f-b685-3a97f18242d0', '2524e32d-9994-40e7-a5ff-63d2e191eb57', '1fa7266f-1563-4676-a5ed-7b831b565e92', '21cb62dc-6dac-4f3b-a22d-5e562e9b9a40'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:52:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5c52ae6a-2706-4e85-8aec-245526fc7d21 tempest-VolumesTransfersTest-1081445498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5c52ae6a-2706-4e85-8aec-245526fc7d21 tempest-VolumesTransfersTest-1081445498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:56 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-5c52ae6a-2706-4e85-8aec-245526fc7d21 tempest-VolumesTransfersTest-1081445498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:52:56 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-5c52ae6a-2706-4e85-8aec-245526fc7d21 tempest-VolumesTransfersTest-1081445498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:52:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5c52ae6a-2706-4e85-8aec-245526fc7d21 tempest-VolumesTransfersTest-1081445498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5c52ae6a-2706-4e85-8aec-245526fc7d21 tempest-VolumesTransfersTest-1081445498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:56 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c57f5c07-f2d7-49ac-a09c-7dbc16e1d96d tempest-VolumeQuotasAdminTestJSON-1351409433 None] Acquiring lock "cinder-9a3911ed-1507-46d4-9dce-b34721c5849a-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:56 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:52:56 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:56 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c57f5c07-f2d7-49ac-a09c-7dbc16e1d96d tempest-VolumeQuotasAdminTestJSON-1351409433 None] Lock "cinder-9a3911ed-1507-46d4-9dce-b34721c5849a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:56 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c57f5c07-f2d7-49ac-a09c-7dbc16e1d96d tempest-VolumeQuotasAdminTestJSON-1351409433 None] Acquiring lock "cinder-quobyte-9a3911ed-1507-46d4-9dce-b34721c5849a" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:52:56 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c57f5c07-f2d7-49ac-a09c-7dbc16e1d96d tempest-VolumeQuotasAdminTestJSON-1351409433 None] Lock "cinder-quobyte-9a3911ed-1507-46d4-9dce-b34721c5849a" acquired by "delete_volume" :: waited 0.021s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:52:56 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37736bf-5030-4864-9d04-1efa1c23ed74]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:52:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c57f5c07-f2d7-49ac-a09c-7dbc16e1d96d tempest-VolumeQuotasAdminTestJSON-1351409433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9a3911ed-1507-46d4-9dce-b34721c5849a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:56 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9a3911ed-1507-46d4-9dce-b34721c5849a Jun 24 09:52:56 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:56 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=113,cinder:UPDATE=161,cinder:INSERT=32,cinder:DELETE=12 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:52:56 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=122,cinder:UPDATE=139,cinder:DELETE=11,cinder:INSERT=41 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:52:56 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:52:56 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Flow 'volume_create_manager' (39f18cf8-a582-41e4-a1c9-7239148a5865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:52:56 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (567c68a4-f91c-4122-8472-c017dee6a3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:56 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5c52ae6a-2706-4e85-8aec-245526fc7d21 tempest-VolumesTransfersTest-1081445498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.873s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:56 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-5c52ae6a-2706-4e85-8aec-245526fc7d21 tempest-VolumesTransfersTest-1081445498 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:52:56 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-5c52ae6a-2706-4e85-8aec-245526fc7d21 tempest-VolumesTransfersTest-1081445498 None] Deleted volume successfully. Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (567c68a4-f91c-4122-8472-c017dee6a3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2145556511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f87dbb1-5215-489e-88de-119513c61ec4,host='devstack@QuobyteHD#QuobyteHD',id=3f4543b1-6a10-4872-98b7-7e3fdadf6f0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5915f656abf74a1cb3404bebc6661c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:52:57Z,use_quota=True,user_id='a58a07565744453297920119b253d40c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df407c57-31e9-4ecb-be04-9ed3e4ad02d4),volume_type_id=df407c57-31e9-4ecb-be04-9ed3e4ad02d4)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (308fc43b-83fa-4d2b-8801-0d55f0a0df46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (308fc43b-83fa-4d2b-8801-0d55f0a0df46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2876e77-cb67-475a-8ab2-db9a852a8733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2876e77-cb67-475a-8ab2-db9a852a8733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f4543b1-6a10-4872-98b7-7e3fdadf6f0b', 'volume_name': 'volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d83314e-fe2f-44ba-a0c2-a1d138e99d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d83314e-fe2f-44ba-a0c2-a1d138e99d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ba943b0-8c21-4068-bcb5-8ba6de26cab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:57 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Volume 3f4543b1-6a10-4872-98b7-7e3fdadf6f0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b', 'volume_size': 1} Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7f87dbb1-5215-489e-88de-119513c61ec4,created_at=2026-06-24T07:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2145556511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f87dbb1-5215-489e-88de-119513c61ec4,host='devstack@QuobyteHD#QuobyteHD',id=3f4543b1-6a10-4872-98b7-7e3fdadf6f0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5915f656abf74a1cb3404bebc6661c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:52:57Z,use_quota=True,user_id='a58a07565744453297920119b253d40c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df407c57-31e9-4ecb-be04-9ed3e4ad02d4),volume_type_id=df407c57-31e9-4ecb-be04-9ed3e4ad02d4)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Creating volume 3f4543b1-6a10-4872-98b7-7e3fdadf6f0b {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:52:57 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5c52ae6a-2706-4e85-8aec-245526fc7d21 tempest-VolumesTransfersTest-1081445498 None] Lock "cinder-2f56e38b-134d-4913-a242-8f77925a2b04-delete_volume" released by "delete_volume" :: held 2.971s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:57 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b 1073741824 Jun 24 09:52:57 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:57 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c57f5c07-f2d7-49ac-a09c-7dbc16e1d96d tempest-VolumeQuotasAdminTestJSON-1351409433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9a3911ed-1507-46d4-9dce-b34721c5849a" returned: 0 in 0.944s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c57f5c07-f2d7-49ac-a09c-7dbc16e1d96d tempest-VolumeQuotasAdminTestJSON-1351409433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9a3911ed-1507-46d4-9dce-b34721c5849a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:57 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9a3911ed-1507-46d4-9dce-b34721c5849a Jun 24 09:52:57 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:57 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c57f5c07-f2d7-49ac-a09c-7dbc16e1d96d tempest-VolumeQuotasAdminTestJSON-1351409433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9a3911ed-1507-46d4-9dce-b34721c5849a" returned: 0 in 0.714s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c57f5c07-f2d7-49ac-a09c-7dbc16e1d96d tempest-VolumeQuotasAdminTestJSON-1351409433 None] Lock "cinder-quobyte-9a3911ed-1507-46d4-9dce-b34721c5849a" released by "delete_volume" :: held 1.717s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:57 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-c57f5c07-f2d7-49ac-a09c-7dbc16e1d96d tempest-VolumeQuotasAdminTestJSON-1351409433 None] Created reservations ['5180ee17-1d9b-45d6-bb6f-49db819b5daa', '9e62394d-41ed-410f-a7e6-3d5b46700ca8', '018dc103-1b26-4abd-a1d2-523b0f12649a', 'b49be71e-7a82-483c-af8a-6b99901bc045'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:52:58 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c57f5c07-f2d7-49ac-a09c-7dbc16e1d96d tempest-VolumeQuotasAdminTestJSON-1351409433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c57f5c07-f2d7-49ac-a09c-7dbc16e1d96d tempest-VolumeQuotasAdminTestJSON-1351409433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:58 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c57f5c07-f2d7-49ac-a09c-7dbc16e1d96d tempest-VolumeQuotasAdminTestJSON-1351409433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:52:58 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c57f5c07-f2d7-49ac-a09c-7dbc16e1d96d tempest-VolumeQuotasAdminTestJSON-1351409433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:52:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c57f5c07-f2d7-49ac-a09c-7dbc16e1d96d tempest-VolumeQuotasAdminTestJSON-1351409433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c57f5c07-f2d7-49ac-a09c-7dbc16e1d96d tempest-VolumeQuotasAdminTestJSON-1351409433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b 1073741824" returned: 0 in 1.027s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:58 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:52:58 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:58 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b Jun 24 09:52:58 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:58 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c57f5c07-f2d7-49ac-a09c-7dbc16e1d96d tempest-VolumeQuotasAdminTestJSON-1351409433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.918s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:58 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-c57f5c07-f2d7-49ac-a09c-7dbc16e1d96d tempest-VolumeQuotasAdminTestJSON-1351409433 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:52:58 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Jun 24 09:52:58 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-c57f5c07-f2d7-49ac-a09c-7dbc16e1d96d tempest-VolumeQuotasAdminTestJSON-1351409433 None] Deleted volume successfully. Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b" returned: 0 in 0.880s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ba943b0-8c21-4068-bcb5-8ba6de26cab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49391e28-4b6c-4e37-b8ed-a7c904ee5a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c57f5c07-f2d7-49ac-a09c-7dbc16e1d96d tempest-VolumeQuotasAdminTestJSON-1351409433 None] Lock "cinder-9a3911ed-1507-46d4-9dce-b34721c5849a-delete_volume" released by "delete_volume" :: held 2.914s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:52:59 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Volume volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b (3f4543b1-6a10-4872-98b7-7e3fdadf6f0b): created successfully Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49391e28-4b6c-4e37-b8ed-a7c904ee5a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Flow 'volume_create_manager' (39f18cf8-a582-41e4-a1c9-7239148a5865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:52:59 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-8c012b40-c963-44c8-be89-b1fdc49cdcc9 tempest-GroupSnapshotsTest-344279173 None] Created volume successfully. Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Flow 'volume_create_manager' (ab535024-2c4b-487c-ae53-5f0cd3a41052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6457b5-d5f8-439f-babe-16bfdd231368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6457b5-d5f8-439f-babe-16bfdd231368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-24449834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c51e191-e3bf-46ed-97f6-06d07ff553ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f5903f31ec48a8a6400b6f905d92dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:52:59Z,use_quota=True,user_id='e68081b235d840b7a9e2d2f379deba94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e36309c-0528-439b-91ea-9554aae5c529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e36309c-0528-439b-91ea-9554aae5c529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11623394-3c20-4dee-8eb8-d12394f23c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11623394-3c20-4dee-8eb8-d12394f23c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c51e191-e3bf-46ed-97f6-06d07ff553ab', 'volume_name': 'volume-7c51e191-e3bf-46ed-97f6-06d07ff553ab', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a66e37-e696-468b-a013-692344dfa196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a66e37-e696-468b-a013-692344dfa196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eebb720-feea-4a42-b5b5-ebf22225e45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:52:59 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Volume 7c51e191-e3bf-46ed-97f6-06d07ff553ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c51e191-e3bf-46ed-97f6-06d07ff553ab', 'volume_size': 1} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-24449834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c51e191-e3bf-46ed-97f6-06d07ff553ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44f5903f31ec48a8a6400b6f905d92dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:52:59Z,use_quota=True,user_id='e68081b235d840b7a9e2d2f379deba94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Creating volume 7c51e191-e3bf-46ed-97f6-06d07ff553ab {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:52:59 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c51e191-e3bf-46ed-97f6-06d07ff553ab 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:52:59 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c51e191-e3bf-46ed-97f6-06d07ff553ab 1073741824 Jun 24 09:52:59 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:52:59 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-8f7a2ddb-22bf-4b3f-8226-f8fd722a5930 tempest-GroupSnapshotsTest-344279173 None] GroupSnapshot 98d1fd9c-0d64-469b-8686-d136572a5b5d: creating. Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8f7a2ddb-22bf-4b3f-8226-f8fd722a5930 tempest-GroupSnapshotsTest-344279173 None] Group snapshot 98d1fd9c-0d64-469b-8686-d136572a5b5d: creating. {{(pid=93447) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 24 09:52:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8f7a2ddb-22bf-4b3f-8226-f8fd722a5930 tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:00 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c51e191-e3bf-46ed-97f6-06d07ff553ab 1073741824" returned: 0 in 1.097s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c51e191-e3bf-46ed-97f6-06d07ff553ab {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:00 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c51e191-e3bf-46ed-97f6-06d07ff553ab Jun 24 09:53:00 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:01 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c51e191-e3bf-46ed-97f6-06d07ff553ab" returned: 0 in 0.960s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:01 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] <== create_volume: return (2101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:53:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.104s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8f7a2ddb-22bf-4b3f-8226-f8fd722a5930 tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.491s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:01 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eebb720-feea-4a42-b5b5-ebf22225e45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c51e191-e3bf-46ed-97f6-06d07ff553ab', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:01 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c097ad-39d4-4c32-ae91-f2ce1a605a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:01 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-8f7a2ddb-22bf-4b3f-8226-f8fd722a5930 tempest-GroupSnapshotsTest-344279173 None] Creating offline snapshot 1c68e3cd-0ae8-420f-a141-fd1704ba606f of volume 3f4543b1-6a10-4872-98b7-7e3fdadf6f0b {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 09:53:01 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Volume volume-7c51e191-e3bf-46ed-97f6-06d07ff553ab (7c51e191-e3bf-46ed-97f6-06d07ff553ab): created successfully Jun 24 09:53:01 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c097ad-39d4-4c32-ae91-f2ce1a605a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:01 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Flow 'volume_create_manager' (ab535024-2c4b-487c-ae53-5f0cd3a41052) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:53:01 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[810066b9-7a9f-473f-9bc9-7b96b45561e2]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:53:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8f7a2ddb-22bf-4b3f-8226-f8fd722a5930 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:01 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-956e0e27-7117-4eb7-9138-6d47d3724f80 tempest-VolumeQuotasAdminTestJSON-1351409433 None] Created volume successfully. Jun 24 09:53:01 devstack sudo[102766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b Jun 24 09:53:01 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:02 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8f7a2ddb-22bf-4b3f-8226-f8fd722a5930 tempest-GroupSnapshotsTest-344279173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b" returned: 0 in 0.941s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8f7a2ddb-22bf-4b3f-8226-f8fd722a5930 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.1c68e3cd-0ae8-420f-a141-fd1704ba606f 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:02 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.1c68e3cd-0ae8-420f-a141-fd1704ba606f 1G Jun 24 09:53:02 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:03 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-9b134b33-707f-4ad6-a2cf-18d7ab71acb8 tempest-VolumeQuotasAdminTestJSON-570247196 None] Transfer volume completed successfully. Jun 24 09:53:03 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8f7a2ddb-22bf-4b3f-8226-f8fd722a5930 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.1c68e3cd-0ae8-420f-a141-fd1704ba606f 1G" returned: 0 in 1.164s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8f7a2ddb-22bf-4b3f-8226-f8fd722a5930 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.1c68e3cd-0ae8-420f-a141-fd1704ba606f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:03 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.1c68e3cd-0ae8-420f-a141-fd1704ba606f Jun 24 09:53:03 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:04 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8f7a2ddb-22bf-4b3f-8226-f8fd722a5930 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.1c68e3cd-0ae8-420f-a141-fd1704ba606f" returned: 0 in 0.771s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:04 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-8f7a2ddb-22bf-4b3f-8226-f8fd722a5930 tempest-GroupSnapshotsTest-344279173 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.1c68e3cd-0ae8-420f-a141-fd1704ba606f is being set with open permissions: ugo+rw: NotImplementedError Jun 24 09:53:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8f7a2ddb-22bf-4b3f-8226-f8fd722a5930 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.1c68e3cd-0ae8-420f-a141-fd1704ba606f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:04 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.1c68e3cd-0ae8-420f-a141-fd1704ba606f Jun 24 09:53:04 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:04 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9eae2f58-72dd-4be4-a556-321363adf2ac tempest-VolumeQuotasAdminTestJSON-333469287 None] Acquiring lock "cinder-7c51e191-e3bf-46ed-97f6-06d07ff553ab-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:53:04 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9eae2f58-72dd-4be4-a556-321363adf2ac tempest-VolumeQuotasAdminTestJSON-333469287 None] Lock "cinder-7c51e191-e3bf-46ed-97f6-06d07ff553ab-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:53:04 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9eae2f58-72dd-4be4-a556-321363adf2ac tempest-VolumeQuotasAdminTestJSON-333469287 None] Acquiring lock "cinder-quobyte-7c51e191-e3bf-46ed-97f6-06d07ff553ab" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:53:04 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9eae2f58-72dd-4be4-a556-321363adf2ac tempest-VolumeQuotasAdminTestJSON-333469287 None] Lock "cinder-quobyte-7c51e191-e3bf-46ed-97f6-06d07ff553ab" acquired by "delete_volume" :: waited 0.016s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:53:04 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[122bee29-8986-425e-a0e3-7ea817da85dc]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:53:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9eae2f58-72dd-4be4-a556-321363adf2ac tempest-VolumeQuotasAdminTestJSON-333469287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c51e191-e3bf-46ed-97f6-06d07ff553ab {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:04 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:53:04 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c51e191-e3bf-46ed-97f6-06d07ff553ab Jun 24 09:53:04 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Flow 'volume_create_manager' (fcab3618-f399-466f-95fd-a0277782df0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:53:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9cd453c-d589-4ebc-864e-3b7a2bd467c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9cd453c-d589-4ebc-864e-3b7a2bd467c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1028641517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46380f84-05b7-4838-a341-57088efd9510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='243421b477c140ff85ab28eb4c3daea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:53:05Z,use_quota=True,user_id='d75aab33a02949cb892219d9eee0993b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34318ce-a2ba-4cb0-951e-d5c530778848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34318ce-a2ba-4cb0-951e-d5c530778848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df15efc9-8429-4e8f-b2e1-f538c9866c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df15efc9-8429-4e8f-b2e1-f538c9866c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46380f84-05b7-4838-a341-57088efd9510', 'volume_name': 'volume-46380f84-05b7-4838-a341-57088efd9510', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4403bf21-ea38-4cf0-97b3-8c404cb1267f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4403bf21-ea38-4cf0-97b3-8c404cb1267f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1ab90a-7e99-4d1f-a043-a636e5840aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:04 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Volume 46380f84-05b7-4838-a341-57088efd9510: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46380f84-05b7-4838-a341-57088efd9510', 'volume_size': 1} Jun 24 09:53:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:05 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8f7a2ddb-22bf-4b3f-8226-f8fd722a5930 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.1c68e3cd-0ae8-420f-a141-fd1704ba606f" returned: 0 in 0.729s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8f7a2ddb-22bf-4b3f-8226-f8fd722a5930 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:05 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.info Jun 24 09:53:05 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:05 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9eae2f58-72dd-4be4-a556-321363adf2ac tempest-VolumeQuotasAdminTestJSON-333469287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c51e191-e3bf-46ed-97f6-06d07ff553ab" returned: 0 in 0.844s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9eae2f58-72dd-4be4-a556-321363adf2ac tempest-VolumeQuotasAdminTestJSON-333469287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c51e191-e3bf-46ed-97f6-06d07ff553ab {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:05 devstack sudo[102798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c51e191-e3bf-46ed-97f6-06d07ff553ab Jun 24 09:53:05 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:05 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8f7a2ddb-22bf-4b3f-8226-f8fd722a5930 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.info" returned: 0 in 0.703s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:05 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-8f7a2ddb-22bf-4b3f-8226-f8fd722a5930 tempest-GroupSnapshotsTest-344279173 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.info is being set with open permissions: ugo+rw: NotImplementedError Jun 24 09:53:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8f7a2ddb-22bf-4b3f-8226-f8fd722a5930 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:05 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.info Jun 24 09:53:05 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:06 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9eae2f58-72dd-4be4-a556-321363adf2ac tempest-VolumeQuotasAdminTestJSON-333469287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c51e191-e3bf-46ed-97f6-06d07ff553ab" returned: 0 in 0.665s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:06 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9eae2f58-72dd-4be4-a556-321363adf2ac tempest-VolumeQuotasAdminTestJSON-333469287 None] Lock "cinder-quobyte-7c51e191-e3bf-46ed-97f6-06d07ff553ab" released by "delete_volume" :: held 1.565s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:53:06 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-9eae2f58-72dd-4be4-a556-321363adf2ac tempest-VolumeQuotasAdminTestJSON-333469287 None] Created reservations ['90f87e44-2b8f-461d-b871-3e9da4da4571', 'de0e8968-5635-481a-b174-77e4d9aebcda', '6c24e7fa-294d-4a7e-a898-f2f03fa3bc05', '9e07634d-246a-4631-a092-d544b07b49f1'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:53:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9eae2f58-72dd-4be4-a556-321363adf2ac tempest-VolumeQuotasAdminTestJSON-333469287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9eae2f58-72dd-4be4-a556-321363adf2ac tempest-VolumeQuotasAdminTestJSON-333469287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:06 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9eae2f58-72dd-4be4-a556-321363adf2ac tempest-VolumeQuotasAdminTestJSON-333469287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:53:06 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9eae2f58-72dd-4be4-a556-321363adf2ac tempest-VolumeQuotasAdminTestJSON-333469287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:53:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9eae2f58-72dd-4be4-a556-321363adf2ac tempest-VolumeQuotasAdminTestJSON-333469287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9eae2f58-72dd-4be4-a556-321363adf2ac tempest-VolumeQuotasAdminTestJSON-333469287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:06 devstack sudo[102804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:53:06 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:06 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8f7a2ddb-22bf-4b3f-8226-f8fd722a5930 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.info" returned: 0 in 0.657s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8f7a2ddb-22bf-4b3f-8226-f8fd722a5930 tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.111s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.635s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:06 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1028641517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46380f84-05b7-4838-a341-57088efd9510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='243421b477c140ff85ab28eb4c3daea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:53:05Z,use_quota=True,user_id='d75aab33a02949cb892219d9eee0993b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:53:06 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Creating volume 46380f84-05b7-4838-a341-57088efd9510 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:53:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:06 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:53:06 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:53:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:06 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:53:06 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:53:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-46380f84-05b7-4838-a341-57088efd9510 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:06 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-46380f84-05b7-4838-a341-57088efd9510 1073741824 Jun 24 09:53:06 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:06 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-8f7a2ddb-22bf-4b3f-8226-f8fd722a5930 tempest-GroupSnapshotsTest-344279173 None] group_snapshot 98d1fd9c-0d64-469b-8686-d136572a5b5d: created successfully Jun 24 09:53:06 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9eae2f58-72dd-4be4-a556-321363adf2ac tempest-VolumeQuotasAdminTestJSON-333469287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.689s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:06 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-9eae2f58-72dd-4be4-a556-321363adf2ac tempest-VolumeQuotasAdminTestJSON-333469287 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:53:06 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-9eae2f58-72dd-4be4-a556-321363adf2ac tempest-VolumeQuotasAdminTestJSON-333469287 None] Deleted volume successfully. Jun 24 09:53:06 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9eae2f58-72dd-4be4-a556-321363adf2ac tempest-VolumeQuotasAdminTestJSON-333469287 None] Lock "cinder-7c51e191-e3bf-46ed-97f6-06d07ff553ab-delete_volume" released by "delete_volume" :: held 2.493s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:53:07 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-46380f84-05b7-4838-a341-57088efd9510 1073741824" returned: 0 in 0.990s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-46380f84-05b7-4838-a341-57088efd9510 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:07 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-46380f84-05b7-4838-a341-57088efd9510 Jun 24 09:53:07 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:08 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-46380f84-05b7-4838-a341-57088efd9510" returned: 0 in 0.786s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1ab90a-7e99-4d1f-a043-a636e5840aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46380f84-05b7-4838-a341-57088efd9510', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6157be20-67af-4edd-817a-7782bf5c2abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:08 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Volume volume-46380f84-05b7-4838-a341-57088efd9510 (46380f84-05b7-4838-a341-57088efd9510): created successfully Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6157be20-67af-4edd-817a-7782bf5c2abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Flow 'volume_create_manager' (fcab3618-f399-466f-95fd-a0277782df0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:53:08 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-a6cbdebe-618e-46c7-bffe-07e2f493182b tempest-VolumesTransfersV357Test-82879886 None] Created volume successfully. Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "cinder-quobyte-1c68e3cd-0ae8-420f-a141-fd1704ba606f-a1df7dc0-3133-4c5b-a2d9-2735756369a2" by "_create_volume_from_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-1c68e3cd-0ae8-420f-a141-fd1704ba606f-a1df7dc0-3133-4c5b-a2d9-2735756369a2" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Creating volume a1df7dc0-3133-4c5b-a2d9-2735756369a2 from snapshot 1c68e3cd-0ae8-420f-a141-fd1704ba606f {{(pid=93447) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "cinder-quobyte-a1df7dc0-3133-4c5b-a2d9-2735756369a2" by "_copy_volume_from_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-a1df7dc0-3133-4c5b-a2d9-2735756369a2" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] snapshot: 1c68e3cd-0ae8-420f-a141-fd1704ba606f, volume: a1df7dc0-3133-4c5b-a2d9-2735756369a2, {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d808cdb9-ce6b-4767-b863-07ffa01506a4]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:53:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.1c68e3cd-0ae8-420f-a141-fd1704ba606f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:09 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.1c68e3cd-0ae8-420f-a141-fd1704ba606f Jun 24 09:53:09 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:09 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.1c68e3cd-0ae8-420f-a141-fd1704ba606f" returned: 0 in 1.099s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:09 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:53:09 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 09:53:09 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Creating direct copy from snapshot {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 09:53:09 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52dd465-e3e8-4af1-b53b-3e9e8c2699b3]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:53:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:10 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-de2d59b5-27d1-4481-b49e-6e5351de5c33 tempest-VolumesTransfersV357Test-219635060 None] Transfer volume completed successfully. Jun 24 09:53:10 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b Jun 24 09:53:10 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:10 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b" returned: 0 in 0.931s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:10 devstack cinder-volume[93447]: DEBUG cinder.utils [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Path /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1df7dc0-3133-4c5b-a2d9-2735756369a2 not found in is_blk_device check {{(pid=93447) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 09:53:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1df7dc0-3133-4c5b-a2d9-2735756369a2 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:10 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1df7dc0-3133-4c5b-a2d9-2735756369a2 Jun 24 09:53:10 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:11 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e6f3918c-4574-4571-ad44-0570b8ca7a3c tempest-VolumesTransfersV357Test-1394715491 None] Acquiring lock "cinder-46380f84-05b7-4838-a341-57088efd9510-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:53:11 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e6f3918c-4574-4571-ad44-0570b8ca7a3c tempest-VolumesTransfersV357Test-1394715491 None] Lock "cinder-46380f84-05b7-4838-a341-57088efd9510-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:53:11 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e6f3918c-4574-4571-ad44-0570b8ca7a3c tempest-VolumesTransfersV357Test-1394715491 None] Acquiring lock "cinder-quobyte-46380f84-05b7-4838-a341-57088efd9510" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:53:11 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e6f3918c-4574-4571-ad44-0570b8ca7a3c tempest-VolumesTransfersV357Test-1394715491 None] Lock "cinder-quobyte-46380f84-05b7-4838-a341-57088efd9510" acquired by "delete_volume" :: waited 0.019s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:53:11 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2058dd-fe4e-432d-8dc0-8148ee7c3a4f]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:53:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e6f3918c-4574-4571-ad44-0570b8ca7a3c tempest-VolumesTransfersV357Test-1394715491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-46380f84-05b7-4838-a341-57088efd9510 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:11 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-46380f84-05b7-4838-a341-57088efd9510 Jun 24 09:53:11 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:13 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e6f3918c-4574-4571-ad44-0570b8ca7a3c tempest-VolumesTransfersV357Test-1394715491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-46380f84-05b7-4838-a341-57088efd9510" returned: 0 in 1.658s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e6f3918c-4574-4571-ad44-0570b8ca7a3c tempest-VolumesTransfersV357Test-1394715491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-46380f84-05b7-4838-a341-57088efd9510 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:13 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-46380f84-05b7-4838-a341-57088efd9510 Jun 24 09:53:13 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:14 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e6f3918c-4574-4571-ad44-0570b8ca7a3c tempest-VolumesTransfersV357Test-1394715491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-46380f84-05b7-4838-a341-57088efd9510" returned: 0 in 1.339s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:14 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e6f3918c-4574-4571-ad44-0570b8ca7a3c tempest-VolumesTransfersV357Test-1394715491 None] Lock "cinder-quobyte-46380f84-05b7-4838-a341-57088efd9510" released by "delete_volume" :: held 3.086s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:53:15 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-e6f3918c-4574-4571-ad44-0570b8ca7a3c tempest-VolumesTransfersV357Test-1394715491 None] Created reservations ['59359a2f-9587-4a78-b25f-f97d4f80c10c', '06f8361b-f3e8-4b1a-b52a-887a3767c5e3', '34a1787d-8e91-4bbd-974a-6edbc84e8526', '02880582-02d2-4202-9e99-f29e6c0005a6'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:53:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e6f3918c-4574-4571-ad44-0570b8ca7a3c tempest-VolumesTransfersV357Test-1394715491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e6f3918c-4574-4571-ad44-0570b8ca7a3c tempest-VolumesTransfersV357Test-1394715491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:15 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-e6f3918c-4574-4571-ad44-0570b8ca7a3c tempest-VolumesTransfersV357Test-1394715491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:53:15 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-e6f3918c-4574-4571-ad44-0570b8ca7a3c tempest-VolumesTransfersV357Test-1394715491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:53:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e6f3918c-4574-4571-ad44-0570b8ca7a3c tempest-VolumesTransfersV357Test-1394715491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e6f3918c-4574-4571-ad44-0570b8ca7a3c tempest-VolumesTransfersV357Test-1394715491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:15 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:53:15 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:17 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:53:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Flow 'volume_create_manager' (1f66a6e5-b402-4ab8-9a55-0cc84a96a6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:53:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dcadedc-6925-41f1-af05-e87e3b2ecc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dcadedc-6925-41f1-af05-e87e3b2ecc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-509926260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f304416-d6c8-47e0-9100-0cf91fbf5d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='243421b477c140ff85ab28eb4c3daea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:53:17Z,use_quota=True,user_id='d75aab33a02949cb892219d9eee0993b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56993b6d-70dc-4ce5-b621-caccd033ef12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56993b6d-70dc-4ce5-b621-caccd033ef12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f98bb1a9-6373-4aab-830f-b5e3ce085d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f98bb1a9-6373-4aab-830f-b5e3ce085d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f304416-d6c8-47e0-9100-0cf91fbf5d3b', 'volume_name': 'volume-4f304416-d6c8-47e0-9100-0cf91fbf5d3b', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (072e37fc-248b-4a5e-bcc8-696e6c83592a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (072e37fc-248b-4a5e-bcc8-696e6c83592a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f63ca2-7b01-4719-ad50-805cd8791d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:17 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Volume 4f304416-d6c8-47e0-9100-0cf91fbf5d3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f304416-d6c8-47e0-9100-0cf91fbf5d3b', 'volume_size': 1} Jun 24 09:53:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:17 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e6f3918c-4574-4571-ad44-0570b8ca7a3c tempest-VolumesTransfersV357Test-1394715491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 2.248s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:17 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-e6f3918c-4574-4571-ad44-0570b8ca7a3c tempest-VolumesTransfersV357Test-1394715491 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:53:17 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-e6f3918c-4574-4571-ad44-0570b8ca7a3c tempest-VolumesTransfersV357Test-1394715491 None] Deleted volume successfully. Jun 24 09:53:17 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e6f3918c-4574-4571-ad44-0570b8ca7a3c tempest-VolumesTransfersV357Test-1394715491 None] Lock "cinder-46380f84-05b7-4838-a341-57088efd9510-delete_volume" released by "delete_volume" :: held 6.016s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:53:17 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1df7dc0-3133-4c5b-a2d9-2735756369a2" returned: 0 in 6.916s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:17 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2ef70a-d91f-4abf-9f72-35692146a552]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:53:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:17 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b Jun 24 09:53:17 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:18 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b" returned: 0 in 0.970s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:18 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b, size 1024.00 MB, duration 6.92 sec, destination /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1df7dc0-3133-4c5b-a2d9-2735756369a2 {{(pid=93447) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 09:53:18 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Converted 1024.00 MB image at 148.04 MB/s Jun 24 09:53:18 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1df7dc0-3133-4c5b-a2d9-2735756369a2 is being set with open permissions: ugo+rw: NotImplementedError Jun 24 09:53:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1df7dc0-3133-4c5b-a2d9-2735756369a2 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:18 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1df7dc0-3133-4c5b-a2d9-2735756369a2 Jun 24 09:53:18 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Flow 'volume_create_manager' (6559b3f4-5fe7-4279-8fec-f12cb64386f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43052ac-373d-45fc-8a34-0fe42c1146a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43052ac-373d-45fc-8a34-0fe42c1146a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-936189161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8148fe4-4823-4a8c-bdca-ff9493f9bb66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c998ba13a5d94bf2b62894c8235eb236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:53:20Z,use_quota=True,user_id='325cc790e04b431598e717ec8804dffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde86fb5-25cd-4b3e-b6f5-994ca80127d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde86fb5-25cd-4b3e-b6f5-994ca80127d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa6a6b2-4f12-4baf-9882-e45b34bf66ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa6a6b2-4f12-4baf-9882-e45b34bf66ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8148fe4-4823-4a8c-bdca-ff9493f9bb66', 'volume_name': 'volume-e8148fe4-4823-4a8c-bdca-ff9493f9bb66', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bdb4d72-8442-4531-b6a7-b1880b70ce1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bdb4d72-8442-4531-b6a7-b1880b70ce1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (291a55c8-3a53-4482-8bc7-747497421a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:19 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Volume e8148fe4-4823-4a8c-bdca-ff9493f9bb66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8148fe4-4823-4a8c-bdca-ff9493f9bb66', 'volume_size': 1} Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:19 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1df7dc0-3133-4c5b-a2d9-2735756369a2" returned: 0 in 1.090s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-a1df7dc0-3133-4c5b-a2d9-2735756369a2" released by "_copy_volume_from_snapshot" :: held 11.148s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-1c68e3cd-0ae8-420f-a141-fd1704ba606f-a1df7dc0-3133-4c5b-a2d9-2735756369a2" released by "_create_volume_from_snapshot" :: held 11.189s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.208s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.511s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-509926260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f304416-d6c8-47e0-9100-0cf91fbf5d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='243421b477c140ff85ab28eb4c3daea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:53:17Z,use_quota=True,user_id='d75aab33a02949cb892219d9eee0993b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Creating volume 4f304416-d6c8-47e0-9100-0cf91fbf5d3b {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:53:19 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:53:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-4f304416-d6c8-47e0-9100-0cf91fbf5d3b 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:19 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-4f304416-d6c8-47e0-9100-0cf91fbf5d3b 1073741824 Jun 24 09:53:19 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:20 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-2afe9dd9-57c9-4c8c-8435-674ccc78b66d tempest-GroupSnapshotsTest-344279173 None] Create group from source-snapshot-98d1fd9c-0d64-469b-8686-d136572a5b5d completed successfully. Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-19dac8e1-2253-42dc-9aa8-97b9fd511909 tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "cinder-quobyte-a1df7dc0-3133-4c5b-a2d9-2735756369a2" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-19dac8e1-2253-42dc-9aa8-97b9fd511909 tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-a1df7dc0-3133-4c5b-a2d9-2735756369a2" acquired by "delete_volume" :: waited 0.016s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:53:21 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-4f304416-d6c8-47e0-9100-0cf91fbf5d3b 1073741824" returned: 0 in 1.103s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[69000b2c-3854-44c1-b323-3f8cbb0d9e27]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-19dac8e1-2253-42dc-9aa8-97b9fd511909 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1df7dc0-3133-4c5b-a2d9-2735756369a2 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-4f304416-d6c8-47e0-9100-0cf91fbf5d3b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:21 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-4f304416-d6c8-47e0-9100-0cf91fbf5d3b Jun 24 09:53:21 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:21 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1df7dc0-3133-4c5b-a2d9-2735756369a2 Jun 24 09:53:21 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:21 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-4f304416-d6c8-47e0-9100-0cf91fbf5d3b" returned: 0 in 0.701s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.900s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-936189161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8148fe4-4823-4a8c-bdca-ff9493f9bb66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c998ba13a5d94bf2b62894c8235eb236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:53:20Z,use_quota=True,user_id='325cc790e04b431598e717ec8804dffd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Creating volume e8148fe4-4823-4a8c-bdca-ff9493f9bb66 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:53:21 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e8148fe4-4823-4a8c-bdca-ff9493f9bb66 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:21 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e8148fe4-4823-4a8c-bdca-ff9493f9bb66 1073741824 Jun 24 09:53:21 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f63ca2-7b01-4719-ad50-805cd8791d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f304416-d6c8-47e0-9100-0cf91fbf5d3b', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82fce8d-7ba7-4937-928d-80596fd039d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:21 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Volume volume-4f304416-d6c8-47e0-9100-0cf91fbf5d3b (4f304416-d6c8-47e0-9100-0cf91fbf5d3b): created successfully Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82fce8d-7ba7-4937-928d-80596fd039d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Flow 'volume_create_manager' (1f66a6e5-b402-4ab8-9a55-0cc84a96a6dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:53:21 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-03b40887-1acc-47f0-aa50-75a3882f690b tempest-VolumesTransfersV357Test-82879886 None] Created volume successfully. Jun 24 09:53:21 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-19dac8e1-2253-42dc-9aa8-97b9fd511909 tempest-GroupSnapshotsTest-344279173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1df7dc0-3133-4c5b-a2d9-2735756369a2" returned: 0 in 0.831s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-19dac8e1-2253-42dc-9aa8-97b9fd511909 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1df7dc0-3133-4c5b-a2d9-2735756369a2 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:21 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1df7dc0-3133-4c5b-a2d9-2735756369a2 Jun 24 09:53:21 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:22 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-19dac8e1-2253-42dc-9aa8-97b9fd511909 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1df7dc0-3133-4c5b-a2d9-2735756369a2" returned: 0 in 0.695s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:22 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-19dac8e1-2253-42dc-9aa8-97b9fd511909 tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-a1df7dc0-3133-4c5b-a2d9-2735756369a2" released by "delete_volume" :: held 1.593s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:53:22 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e8148fe4-4823-4a8c-bdca-ff9493f9bb66 1073741824" returned: 0 in 0.885s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:22 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-19dac8e1-2253-42dc-9aa8-97b9fd511909 tempest-GroupSnapshotsTest-344279173 None] Created reservations ['ce65dce8-3367-4d22-b87e-ed466ce352ba'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:53:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e8148fe4-4823-4a8c-bdca-ff9493f9bb66 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:22 devstack cinder-volume[93447]: WARNING cinder.quota [None req-19dac8e1-2253-42dc-9aa8-97b9fd511909 tempest-GroupSnapshotsTest-344279173 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1946353245 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1946353245, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:53:22 devstack cinder-volume[93447]: WARNING cinder.quota [None req-19dac8e1-2253-42dc-9aa8-97b9fd511909 tempest-GroupSnapshotsTest-344279173 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1946353245 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1946353245, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:53:22 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e8148fe4-4823-4a8c-bdca-ff9493f9bb66 Jun 24 09:53:22 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:22 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-19dac8e1-2253-42dc-9aa8-97b9fd511909 tempest-GroupSnapshotsTest-344279173 None] Created reservations ['5d6775e7-ab59-46d7-94db-b120badf34f0', '005410d9-bc84-4806-9342-3744590bbe18', 'ffd1f336-b6c0-4221-b1bf-ff6363d089fc', '65ff8a42-3a73-4e8e-8f77-a4383a2b8ae9'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:53:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-19dac8e1-2253-42dc-9aa8-97b9fd511909 tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-19dac8e1-2253-42dc-9aa8-97b9fd511909 tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:22 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-19dac8e1-2253-42dc-9aa8-97b9fd511909 tempest-GroupSnapshotsTest-344279173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:53:22 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-19dac8e1-2253-42dc-9aa8-97b9fd511909 tempest-GroupSnapshotsTest-344279173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:53:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-19dac8e1-2253-42dc-9aa8-97b9fd511909 tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-19dac8e1-2253-42dc-9aa8-97b9fd511909 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3032f465-2849-4392-981f-0c9c60ba9069 tempest-VolumesTransfersV357Test-1394715491 None] Acquiring lock "cinder-4f304416-d6c8-47e0-9100-0cf91fbf5d3b-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:53:23 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:53:23 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3032f465-2849-4392-981f-0c9c60ba9069 tempest-VolumesTransfersV357Test-1394715491 None] Lock "cinder-4f304416-d6c8-47e0-9100-0cf91fbf5d3b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:53:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3032f465-2849-4392-981f-0c9c60ba9069 tempest-VolumesTransfersV357Test-1394715491 None] Acquiring lock "cinder-quobyte-4f304416-d6c8-47e0-9100-0cf91fbf5d3b" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:53:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3032f465-2849-4392-981f-0c9c60ba9069 tempest-VolumesTransfersV357Test-1394715491 None] Lock "cinder-quobyte-4f304416-d6c8-47e0-9100-0cf91fbf5d3b" acquired by "delete_volume" :: waited 0.042s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:53:23 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b0c6d9-2b81-467b-89e0-8dc3203b76db]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:53:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3032f465-2849-4392-981f-0c9c60ba9069 tempest-VolumesTransfersV357Test-1394715491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-4f304416-d6c8-47e0-9100-0cf91fbf5d3b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:23 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-4f304416-d6c8-47e0-9100-0cf91fbf5d3b Jun 24 09:53:23 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:23 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-c6563c71-9034-46d4-8abf-6f12eb649f02 tempest-GroupSnapshotsTest-344279173 None] group_snapshot 98d1fd9c-0d64-469b-8686-d136572a5b5d: deleting Jun 24 09:53:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c6563c71-9034-46d4-8abf-6f12eb649f02 tempest-GroupSnapshotsTest-344279173 None] group_snapshot 98d1fd9c-0d64-469b-8686-d136572a5b5d: deleting {{(pid=93447) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 24 09:53:23 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e8148fe4-4823-4a8c-bdca-ff9493f9bb66" returned: 0 in 0.822s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:23 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:53:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c6563c71-9034-46d4-8abf-6f12eb649f02 tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "cinder-quobyte-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:53:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (291a55c8-3a53-4482-8bc7-747497421a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8148fe4-4823-4a8c-bdca-ff9493f9bb66', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef133dd-01b9-48d1-9981-f81a428b60f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c6563c71-9034-46d4-8abf-6f12eb649f02 tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:53:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c6563c71-9034-46d4-8abf-6f12eb649f02 tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "cinder-quobyte-1c68e3cd-0ae8-420f-a141-fd1704ba606f" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:53:23 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Volume volume-e8148fe4-4823-4a8c-bdca-ff9493f9bb66 (e8148fe4-4823-4a8c-bdca-ff9493f9bb66): created successfully Jun 24 09:53:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef133dd-01b9-48d1-9981-f81a428b60f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Flow 'volume_create_manager' (6559b3f4-5fe7-4279-8fec-f12cb64386f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:53:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c6563c71-9034-46d4-8abf-6f12eb649f02 tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-1c68e3cd-0ae8-420f-a141-fd1704ba606f" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:53:23 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-c6563c71-9034-46d4-8abf-6f12eb649f02 tempest-GroupSnapshotsTest-344279173 None] Deleting offline snapshot 1c68e3cd-0ae8-420f-a141-fd1704ba606f of volume 3f4543b1-6a10-4872-98b7-7e3fdadf6f0b {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 09:53:23 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-c6563c71-9034-46d4-8abf-6f12eb649f02 tempest-GroupSnapshotsTest-344279173 None] snapshot_file for this snap is: volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.1c68e3cd-0ae8-420f-a141-fd1704ba606f {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 09:53:23 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-d1292d63-2ee7-4a06-9eea-b33af7ddd1a0 tempest-VolumesServicesTestJSON-1516051724 None] Created volume successfully. Jun 24 09:53:23 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[781a3029-c866-4af5-a22e-fa91ba295757]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:53:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c6563c71-9034-46d4-8abf-6f12eb649f02 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.1c68e3cd-0ae8-420f-a141-fd1704ba606f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:23 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.1c68e3cd-0ae8-420f-a141-fd1704ba606f Jun 24 09:53:23 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:23 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-19dac8e1-2253-42dc-9aa8-97b9fd511909 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.916s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:23 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-19dac8e1-2253-42dc-9aa8-97b9fd511909 tempest-GroupSnapshotsTest-344279173 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:53:23 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-19dac8e1-2253-42dc-9aa8-97b9fd511909 tempest-GroupSnapshotsTest-344279173 None] Delete group completed successfully. Jun 24 09:53:24 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ec7f9c38-474f-4d3f-934b-2d1a9d005063 tempest-VolumesServicesTestJSON-1516051724 None] Acquiring lock "cinder-e8148fe4-4823-4a8c-bdca-ff9493f9bb66-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:53:24 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ec7f9c38-474f-4d3f-934b-2d1a9d005063 tempest-VolumesServicesTestJSON-1516051724 None] Lock "cinder-e8148fe4-4823-4a8c-bdca-ff9493f9bb66-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:53:24 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ec7f9c38-474f-4d3f-934b-2d1a9d005063 tempest-VolumesServicesTestJSON-1516051724 None] Acquiring lock "cinder-quobyte-e8148fe4-4823-4a8c-bdca-ff9493f9bb66" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:53:24 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ec7f9c38-474f-4d3f-934b-2d1a9d005063 tempest-VolumesServicesTestJSON-1516051724 None] Lock "cinder-quobyte-e8148fe4-4823-4a8c-bdca-ff9493f9bb66" acquired by "delete_volume" :: waited 0.014s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:53:24 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3032f465-2849-4392-981f-0c9c60ba9069 tempest-VolumesTransfersV357Test-1394715491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-4f304416-d6c8-47e0-9100-0cf91fbf5d3b" returned: 0 in 1.089s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3032f465-2849-4392-981f-0c9c60ba9069 tempest-VolumesTransfersV357Test-1394715491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-4f304416-d6c8-47e0-9100-0cf91fbf5d3b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:24 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbafd76-1a4a-4869-a31e-2cfe18c8f7d5]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:53:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ec7f9c38-474f-4d3f-934b-2d1a9d005063 tempest-VolumesServicesTestJSON-1516051724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e8148fe4-4823-4a8c-bdca-ff9493f9bb66 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:24 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-4f304416-d6c8-47e0-9100-0cf91fbf5d3b Jun 24 09:53:24 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:24 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e8148fe4-4823-4a8c-bdca-ff9493f9bb66 Jun 24 09:53:24 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:24 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c6563c71-9034-46d4-8abf-6f12eb649f02 tempest-GroupSnapshotsTest-344279173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.1c68e3cd-0ae8-420f-a141-fd1704ba606f" returned: 0 in 0.878s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-c6563c71-9034-46d4-8abf-6f12eb649f02 tempest-GroupSnapshotsTest-344279173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:53:24 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[63882135-223f-46a1-906b-44e988961bc7]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:53:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c6563c71-9034-46d4-8abf-6f12eb649f02 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:24 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b Jun 24 09:53:24 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:24 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:53:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:53:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:53:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:25 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3032f465-2849-4392-981f-0c9c60ba9069 tempest-VolumesTransfersV357Test-1394715491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-4f304416-d6c8-47e0-9100-0cf91fbf5d3b" returned: 0 in 0.747s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:25 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3032f465-2849-4392-981f-0c9c60ba9069 tempest-VolumesTransfersV357Test-1394715491 None] Lock "cinder-quobyte-4f304416-d6c8-47e0-9100-0cf91fbf5d3b" released by "delete_volume" :: held 1.905s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:53:25 devstack sudo[102973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:53:25 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:25 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-3032f465-2849-4392-981f-0c9c60ba9069 tempest-VolumesTransfersV357Test-1394715491 None] Created reservations ['1437f6e2-3c2d-4405-a295-7a67c7de9bbe', '6bf9b9e4-956f-4d18-bff7-2042eb40357d', 'cc30cb9a-990a-4304-b7db-3608ddf20806', '6ed22b64-29d4-4dfc-9011-f775fd6e02a0'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:53:25 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ec7f9c38-474f-4d3f-934b-2d1a9d005063 tempest-VolumesServicesTestJSON-1516051724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e8148fe4-4823-4a8c-bdca-ff9493f9bb66" returned: 0 in 0.868s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ec7f9c38-474f-4d3f-934b-2d1a9d005063 tempest-VolumesServicesTestJSON-1516051724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e8148fe4-4823-4a8c-bdca-ff9493f9bb66 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:25 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e8148fe4-4823-4a8c-bdca-ff9493f9bb66 Jun 24 09:53:25 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3032f465-2849-4392-981f-0c9c60ba9069 tempest-VolumesTransfersV357Test-1394715491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3032f465-2849-4392-981f-0c9c60ba9069 tempest-VolumesTransfersV357Test-1394715491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3032f465-2849-4392-981f-0c9c60ba9069 tempest-VolumesTransfersV357Test-1394715491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:53:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3032f465-2849-4392-981f-0c9c60ba9069 tempest-VolumesTransfersV357Test-1394715491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:53:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3032f465-2849-4392-981f-0c9c60ba9069 tempest-VolumesTransfersV357Test-1394715491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3032f465-2849-4392-981f-0c9c60ba9069 tempest-VolumesTransfersV357Test-1394715491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:25 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:53:25 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:25 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c6563c71-9034-46d4-8abf-6f12eb649f02 tempest-GroupSnapshotsTest-344279173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b" returned: 0 in 1.051s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c6563c71-9034-46d4-8abf-6f12eb649f02 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.1c68e3cd-0ae8-420f-a141-fd1704ba606f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:25 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.1c68e3cd-0ae8-420f-a141-fd1704ba606f Jun 24 09:53:25 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:25 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.895s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:53:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:53:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 8 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 09:53:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 09:53:26 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ec7f9c38-474f-4d3f-934b-2d1a9d005063 tempest-VolumesServicesTestJSON-1516051724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e8148fe4-4823-4a8c-bdca-ff9493f9bb66" returned: 0 in 0.949s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:26 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ec7f9c38-474f-4d3f-934b-2d1a9d005063 tempest-VolumesServicesTestJSON-1516051724 None] Lock "cinder-quobyte-e8148fe4-4823-4a8c-bdca-ff9493f9bb66" released by "delete_volume" :: held 1.873s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:53:26 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-ec7f9c38-474f-4d3f-934b-2d1a9d005063 tempest-VolumesServicesTestJSON-1516051724 None] Created reservations ['1bd4afed-9eb2-4cff-83db-8fb6712734c5', '0ffa9485-2f40-4c6a-9c46-9b6430d60954', '1aa6c248-7049-40b0-9833-9d42be741b34', '5a05ed89-986a-4b2f-8882-dd753d366053'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:53:26 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3032f465-2849-4392-981f-0c9c60ba9069 tempest-VolumesTransfersV357Test-1394715491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.030s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:26 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-3032f465-2849-4392-981f-0c9c60ba9069 tempest-VolumesTransfersV357Test-1394715491 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:53:26 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-3032f465-2849-4392-981f-0c9c60ba9069 tempest-VolumesTransfersV357Test-1394715491 None] Deleted volume successfully. Jun 24 09:53:26 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3032f465-2849-4392-981f-0c9c60ba9069 tempest-VolumesTransfersV357Test-1394715491 None] Lock "cinder-4f304416-d6c8-47e0-9100-0cf91fbf5d3b-delete_volume" released by "delete_volume" :: held 3.278s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:53:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ec7f9c38-474f-4d3f-934b-2d1a9d005063 tempest-VolumesServicesTestJSON-1516051724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ec7f9c38-474f-4d3f-934b-2d1a9d005063 tempest-VolumesServicesTestJSON-1516051724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ec7f9c38-474f-4d3f-934b-2d1a9d005063 tempest-VolumesServicesTestJSON-1516051724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:53:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ec7f9c38-474f-4d3f-934b-2d1a9d005063 tempest-VolumesServicesTestJSON-1516051724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:53:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ec7f9c38-474f-4d3f-934b-2d1a9d005063 tempest-VolumesServicesTestJSON-1516051724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ec7f9c38-474f-4d3f-934b-2d1a9d005063 tempest-VolumesServicesTestJSON-1516051724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:26 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:53:26 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:26 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c6563c71-9034-46d4-8abf-6f12eb649f02 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.1c68e3cd-0ae8-420f-a141-fd1704ba606f" returned: 0 in 1.167s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c6563c71-9034-46d4-8abf-6f12eb649f02 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.1c68e3cd-0ae8-420f-a141-fd1704ba606f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:26 devstack sudo[103017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.1c68e3cd-0ae8-420f-a141-fd1704ba606f Jun 24 09:53:26 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:27 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ec7f9c38-474f-4d3f-934b-2d1a9d005063 tempest-VolumesServicesTestJSON-1516051724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.338s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:27 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-ec7f9c38-474f-4d3f-934b-2d1a9d005063 tempest-VolumesServicesTestJSON-1516051724 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:53:27 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-ec7f9c38-474f-4d3f-934b-2d1a9d005063 tempest-VolumesServicesTestJSON-1516051724 None] Deleted volume successfully. Jun 24 09:53:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ec7f9c38-474f-4d3f-934b-2d1a9d005063 tempest-VolumesServicesTestJSON-1516051724 None] Lock "cinder-e8148fe4-4823-4a8c-bdca-ff9493f9bb66-delete_volume" released by "delete_volume" :: held 3.582s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:53:28 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c6563c71-9034-46d4-8abf-6f12eb649f02 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b.1c68e3cd-0ae8-420f-a141-fd1704ba606f" returned: 0 in 1.574s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:28 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c6563c71-9034-46d4-8abf-6f12eb649f02 tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-1c68e3cd-0ae8-420f-a141-fd1704ba606f" released by "_delete_snapshot" :: held 4.817s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:53:28 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c6563c71-9034-46d4-8abf-6f12eb649f02 tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b" released by "delete_snapshot" :: held 4.878s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:53:28 devstack cinder-volume[93447]: WARNING cinder.quota [None req-c6563c71-9034-46d4-8abf-6f12eb649f02 tempest-GroupSnapshotsTest-344279173 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1946353245 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1946353245, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:53:28 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-c6563c71-9034-46d4-8abf-6f12eb649f02 tempest-GroupSnapshotsTest-344279173 None] Created reservations ['a5979179-7e1f-4eae-9e80-0b204aeeb803', 'e685a46e-7ee8-48bf-8579-f225ad2c32ac', 'd100f859-7831-40ff-bc6b-5d07777d5326', '0382409a-58ed-46cf-a154-3998f3161d9d'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:53:28 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-c6563c71-9034-46d4-8abf-6f12eb649f02 tempest-GroupSnapshotsTest-344279173 None] group_snapshot 98d1fd9c-0d64-469b-8686-d136572a5b5d: deleted successfully Jun 24 09:53:29 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7d4d270b-1740-40a5-80d2-339e084aa49c tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "cinder-quobyte-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:53:29 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7d4d270b-1740-40a5-80d2-339e084aa49c tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b" acquired by "delete_volume" :: waited 0.043s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:53:29 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[51635bf7-8706-4301-83b3-adb1fe24f99d]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:53:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7d4d270b-1740-40a5-80d2-339e084aa49c tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:30 devstack sudo[103080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b Jun 24 09:53:30 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:30 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7d4d270b-1740-40a5-80d2-339e084aa49c tempest-GroupSnapshotsTest-344279173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b" returned: 0 in 1.123s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7d4d270b-1740-40a5-80d2-339e084aa49c tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:31 devstack sudo[103086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b Jun 24 09:53:31 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:32 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7d4d270b-1740-40a5-80d2-339e084aa49c tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b" returned: 0 in 1.158s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:32 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7d4d270b-1740-40a5-80d2-339e084aa49c tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-3f4543b1-6a10-4872-98b7-7e3fdadf6f0b" released by "delete_volume" :: held 2.414s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:53:32 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-7d4d270b-1740-40a5-80d2-339e084aa49c tempest-GroupSnapshotsTest-344279173 None] Created reservations ['fdf3b31e-7560-4e22-b484-91e25aeea91a'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:53:32 devstack cinder-volume[93447]: WARNING cinder.db.api [None req-7d4d270b-1740-40a5-80d2-339e084aa49c tempest-GroupSnapshotsTest-344279173 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1946353245'] Jun 24 09:53:32 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-7d4d270b-1740-40a5-80d2-339e084aa49c tempest-GroupSnapshotsTest-344279173 None] Created reservations ['af9fcfb3-d450-4646-b86a-3efe716c298a', '05a5fa9f-1b11-40bc-b3ab-a25c14f95ac7', '0fa60993-464b-40d2-89ca-7febc8e0ea45', '31b54858-bd02-4ce7-a7fc-46f99c441fc7'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:53:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7d4d270b-1740-40a5-80d2-339e084aa49c tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7d4d270b-1740-40a5-80d2-339e084aa49c tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:32 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7d4d270b-1740-40a5-80d2-339e084aa49c tempest-GroupSnapshotsTest-344279173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:53:32 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7d4d270b-1740-40a5-80d2-339e084aa49c tempest-GroupSnapshotsTest-344279173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:53:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7d4d270b-1740-40a5-80d2-339e084aa49c tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7d4d270b-1740-40a5-80d2-339e084aa49c tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:32 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:53:32 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:33 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7d4d270b-1740-40a5-80d2-339e084aa49c tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.128s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:33 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-7d4d270b-1740-40a5-80d2-339e084aa49c tempest-GroupSnapshotsTest-344279173 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:53:33 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-7d4d270b-1740-40a5-80d2-339e084aa49c tempest-GroupSnapshotsTest-344279173 None] Delete group completed successfully. Jun 24 09:53:34 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-78d09e89-a089-40b5-b237-52b73dddfad4 tempest-GroupSnapshotsTest-344279173 None] Group tempest-GroupSnapshotsTest-Group-883916421: creating Jun 24 09:53:34 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-78d09e89-a089-40b5-b237-52b73dddfad4 tempest-GroupSnapshotsTest-344279173 None] Group tempest-GroupSnapshotsTest-Group-883916421: created successfully Jun 24 09:53:34 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-78d09e89-a089-40b5-b237-52b73dddfad4 tempest-GroupSnapshotsTest-344279173 None] Create group completed successfully. Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Flow 'volume_create_manager' (b290b76d-4042-4359-9688-48158c04f987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71566772-6703-4c4e-9472-c0aa7169ed22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71566772-6703-4c4e-9472-c0aa7169ed22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-806834178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=45c4c55b-2398-4da2-9f79-98457c8bab0e,host='devstack@QuobyteHD#QuobyteHD',id=a6f42d68-853e-42dc-9bcc-05856e27905e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5915f656abf74a1cb3404bebc6661c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:53:37Z,use_quota=True,user_id='a58a07565744453297920119b253d40c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f72fd143-f863-45e8-b9ab-60c444235c0c),volume_type_id=f72fd143-f863-45e8-b9ab-60c444235c0c)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e58de7-f5b3-42c3-9820-b27d9aa729dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e58de7-f5b3-42c3-9820-b27d9aa729dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d84860-bffc-4f96-93b3-5b552a87abee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d84860-bffc-4f96-93b3-5b552a87abee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6f42d68-853e-42dc-9bcc-05856e27905e', 'volume_name': 'volume-a6f42d68-853e-42dc-9bcc-05856e27905e', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea574ba7-5a81-4067-828f-f73946e0fa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea574ba7-5a81-4067-828f-f73946e0fa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e1318c-b9aa-477b-84ed-07618985fd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:36 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Volume a6f42d68-853e-42dc-9bcc-05856e27905e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6f42d68-853e-42dc-9bcc-05856e27905e', 'volume_size': 1} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=45c4c55b-2398-4da2-9f79-98457c8bab0e,created_at=2026-06-24T07:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-806834178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=45c4c55b-2398-4da2-9f79-98457c8bab0e,host='devstack@QuobyteHD#QuobyteHD',id=a6f42d68-853e-42dc-9bcc-05856e27905e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5915f656abf74a1cb3404bebc6661c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:53:37Z,use_quota=True,user_id='a58a07565744453297920119b253d40c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f72fd143-f863-45e8-b9ab-60c444235c0c),volume_type_id=f72fd143-f863-45e8-b9ab-60c444235c0c)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Creating volume a6f42d68-853e-42dc-9bcc-05856e27905e {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:53:36 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Flow 'volume_create_manager' (c1e10e34-e159-4b17-a160-7cd8887c790c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16e608a-da7d-4d71-8669-c56eec9f7211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:36 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e 1073741824 Jun 24 09:53:36 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16e608a-da7d-4d71-8669-c56eec9f7211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1530680102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca682b43-3a05-488a-af79-6720191f16b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0930e05334d743d4995c2ae0cc16800d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:53:37Z,use_quota=True,user_id='032a39daf223414eaf26a639925d165c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a7b8db2-4783-4bb7-a1cf-51bd963872fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a7b8db2-4783-4bb7-a1cf-51bd963872fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a731a211-2132-4c82-b2eb-6d275445c5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a731a211-2132-4c82-b2eb-6d275445c5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca682b43-3a05-488a-af79-6720191f16b0', 'volume_name': 'volume-ca682b43-3a05-488a-af79-6720191f16b0', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce406a6f-1568-4618-a07c-09ed0429ddd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce406a6f-1568-4618-a07c-09ed0429ddd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1909088d-168c-47a5-a46e-cfb95c9ce63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:36 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Volume ca682b43-3a05-488a-af79-6720191f16b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca682b43-3a05-488a-af79-6720191f16b0', 'volume_size': 1} Jun 24 09:53:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:37 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e 1073741824" returned: 0 in 1.143s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:37 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e Jun 24 09:53:37 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:38 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e" returned: 0 in 0.782s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:38 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] <== create_volume: return (1976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:53:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.978s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.863s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:38 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1530680102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca682b43-3a05-488a-af79-6720191f16b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0930e05334d743d4995c2ae0cc16800d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:53:37Z,use_quota=True,user_id='032a39daf223414eaf26a639925d165c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:53:38 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Creating volume ca682b43-3a05-488a-af79-6720191f16b0 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:53:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:38 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:53:38 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:53:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:38 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:53:38 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:53:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e1318c-b9aa-477b-84ed-07618985fd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6f42d68-853e-42dc-9bcc-05856e27905e', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1014d7ae-c8dd-4ac9-81a0-dbebd3f1967c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:38 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Volume volume-a6f42d68-853e-42dc-9bcc-05856e27905e (a6f42d68-853e-42dc-9bcc-05856e27905e): created successfully Jun 24 09:53:38 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0 1073741824 Jun 24 09:53:38 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1014d7ae-c8dd-4ac9-81a0-dbebd3f1967c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Flow 'volume_create_manager' (b290b76d-4042-4359-9688-48158c04f987) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:53:38 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-1292ead1-8740-4201-afea-2569ea76ee07 tempest-GroupSnapshotsTest-344279173 None] Created volume successfully. Jun 24 09:53:39 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0 1073741824" returned: 0 in 1.129s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:39 devstack sudo[103121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0 Jun 24 09:53:39 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:40 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0" returned: 0 in 0.848s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:53:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.048s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1909088d-168c-47a5-a46e-cfb95c9ce63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca682b43-3a05-488a-af79-6720191f16b0', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4df119-d061-4548-a176-3967f560b904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:40 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Volume volume-ca682b43-3a05-488a-af79-6720191f16b0 (ca682b43-3a05-488a-af79-6720191f16b0): created successfully Jun 24 09:53:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4df119-d061-4548-a176-3967f560b904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Flow 'volume_create_manager' (c1e10e34-e159-4b17-a160-7cd8887c790c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:53:40 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-e8a85e49-ddcb-4715-abb1-a614485bfa56 tempest-VolumesCloneTest-1196900690 None] Created volume successfully. Jun 24 09:53:40 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:53:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Flow 'volume_create_manager' (30e6b6bb-a56f-44d0-8d0f-5ee14b73e6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:53:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c9dd6d7-80d5-444d-ad15-7e300dacb6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c9dd6d7-80d5-444d-ad15-7e300dacb6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-4451599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=45c4c55b-2398-4da2-9f79-98457c8bab0e,host='devstack@QuobyteHD#QuobyteHD',id=58100ac4-788b-4cdb-9e9a-1b2c237b7970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5915f656abf74a1cb3404bebc6661c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:53:41Z,use_quota=True,user_id='a58a07565744453297920119b253d40c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f72fd143-f863-45e8-b9ab-60c444235c0c),volume_type_id=f72fd143-f863-45e8-b9ab-60c444235c0c)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677b2750-f78e-4504-86af-fd12b923480d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677b2750-f78e-4504-86af-fd12b923480d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a2f7da4-0299-41f8-b18b-fdab9b7a2943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a2f7da4-0299-41f8-b18b-fdab9b7a2943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58100ac4-788b-4cdb-9e9a-1b2c237b7970', 'volume_name': 'volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b67e50d-0f11-47ea-9980-4c45ef82c17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b67e50d-0f11-47ea-9980-4c45ef82c17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4863eb0-3ea4-4a7c-bb47-521b0f7e7013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:41 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Volume 58100ac4-788b-4cdb-9e9a-1b2c237b7970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970', 'volume_size': 1} Jun 24 09:53:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:41 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=45c4c55b-2398-4da2-9f79-98457c8bab0e,created_at=2026-06-24T07:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-4451599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=45c4c55b-2398-4da2-9f79-98457c8bab0e,host='devstack@QuobyteHD#QuobyteHD',id=58100ac4-788b-4cdb-9e9a-1b2c237b7970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5915f656abf74a1cb3404bebc6661c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:53:41Z,use_quota=True,user_id='a58a07565744453297920119b253d40c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f72fd143-f863-45e8-b9ab-60c444235c0c),volume_type_id=f72fd143-f863-45e8-b9ab-60c444235c0c)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:53:41 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Creating volume 58100ac4-788b-4cdb-9e9a-1b2c237b7970 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:53:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:41 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:53:41 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:53:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:41 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:53:41 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:53:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:41 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970 1073741824 Jun 24 09:53:41 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:41 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970 1073741824" returned: 0 in 0.944s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:42 devstack sudo[103147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970 Jun 24 09:53:42 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:42 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:53:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Flow 'volume_create_manager' (a7987440-db3d-42b8-912f-3328f418e237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:53:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71be13d-8ed8-4d0d-976f-808401700a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71be13d-8ed8-4d0d-976f-808401700a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-774779676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c9a4da-8487-4f21-8bff-19c11910a174,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0930e05334d743d4995c2ae0cc16800d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:53:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=ca682b43-3a05-488a-af79-6720191f16b0,status='creating',terminated_at=None,updated_at=2026-06-24T07:53:42Z,use_quota=True,user_id='032a39daf223414eaf26a639925d165c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e64b92f-1024-4722-b180-d55694b4fd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e64b92f-1024-4722-b180-d55694b4fd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510f6675-94b3-4c00-b1f7-4a60233c7c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510f6675-94b3-4c00-b1f7-4a60233c7c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '68c9a4da-8487-4f21-8bff-19c11910a174', 'volume_name': 'volume-68c9a4da-8487-4f21-8bff-19c11910a174', 'volume_size': 2, 'source_volid': 'ca682b43-3a05-488a-af79-6720191f16b0', 'source_volstatus': 'available'}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe0b051-a611-4810-a787-4339f1e5293c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fe0b051-a611-4810-a787-4339f1e5293c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2900b66-6463-4a4a-9fb1-010161bcd21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:42 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Volume 68c9a4da-8487-4f21-8bff-19c11910a174: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-68c9a4da-8487-4f21-8bff-19c11910a174', 'volume_size': 2, 'source_volid': 'ca682b43-3a05-488a-af79-6720191f16b0', 'source_volstatus': 'available'} Jun 24 09:53:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:42 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970" returned: 0 in 0.770s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:53:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.373s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:42 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Cloning volume ca682b43-3a05-488a-af79-6720191f16b0 to volume 68c9a4da-8487-4f21-8bff-19c11910a174 Jun 24 09:53:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4863eb0-3ea4-4a7c-bb47-521b0f7e7013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e714efd-889d-48c0-bd97-9b97ab98c3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Creating offline snapshot 2ddb37d0-628e-4a69-81c4-568b6a528058 of volume ca682b43-3a05-488a-af79-6720191f16b0 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 09:53:42 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Volume volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970 (58100ac4-788b-4cdb-9e9a-1b2c237b7970): created successfully Jun 24 09:53:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e714efd-889d-48c0-bd97-9b97ab98c3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Flow 'volume_create_manager' (30e6b6bb-a56f-44d0-8d0f-5ee14b73e6ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:53:42 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfa5937-a9c2-4a7a-8f15-d8a981f1ab4b]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:53:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:42 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-43759158-d956-479a-94c8-a8b5b0d835bd tempest-GroupSnapshotsTest-344279173 None] Created volume successfully. Jun 24 09:53:42 devstack sudo[103150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0 Jun 24 09:53:42 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:43 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-42f06dfc-e27d-452c-bab7-2093a3bada2f tempest-GroupSnapshotsTest-344279173 None] Update group completed successfully. Jun 24 09:53:43 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0" returned: 0 in 0.796s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.2ddb37d0-628e-4a69-81c4-568b6a528058 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:43 devstack sudo[103156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.2ddb37d0-628e-4a69-81c4-568b6a528058 1G Jun 24 09:53:43 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:44 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.2ddb37d0-628e-4a69-81c4-568b6a528058 1G" returned: 0 in 0.862s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca682b43-3a05-488a-af79-6720191f16b0 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.2ddb37d0-628e-4a69-81c4-568b6a528058 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:44 devstack sudo[103162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca682b43-3a05-488a-af79-6720191f16b0 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.2ddb37d0-628e-4a69-81c4-568b6a528058 Jun 24 09:53:44 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:44 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-8a69d01d-8ad8-4017-b87c-687835969859 tempest-GroupSnapshotsTest-344279173 None] Update group completed successfully. Jun 24 09:53:45 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca682b43-3a05-488a-af79-6720191f16b0 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.2ddb37d0-628e-4a69-81c4-568b6a528058" returned: 0 in 0.771s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:45 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.2ddb37d0-628e-4a69-81c4-568b6a528058 is being set with open permissions: ugo+rw Jun 24 09:53:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.2ddb37d0-628e-4a69-81c4-568b6a528058 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:45 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.2ddb37d0-628e-4a69-81c4-568b6a528058 Jun 24 09:53:45 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:45 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.2ddb37d0-628e-4a69-81c4-568b6a528058" returned: 0 in 0.667s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:46 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-49f44439-5c2a-434f-b9e2-12fdf97664a6 tempest-GroupSnapshotsTest-344279173 None] Update group completed successfully. Jun 24 09:53:46 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.info Jun 24 09:53:46 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:46 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.info" returned: 0 in 0.648s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:46 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.info is being set with open permissions: ugo+rw Jun 24 09:53:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:46 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.info Jun 24 09:53:46 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:47 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-6e4af6e9-ccfe-49cf-818d-a074fb03b8c0 tempest-GroupSnapshotsTest-344279173 None] Update group completed successfully. Jun 24 09:53:47 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.info" returned: 0 in 0.689s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Acquiring lock "cinder-quobyte-68c9a4da-8487-4f21-8bff-19c11910a174" by "_copy_volume_from_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:53:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Lock "cinder-quobyte-68c9a4da-8487-4f21-8bff-19c11910a174" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:53:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] snapshot: 2ddb37d0-628e-4a69-81c4-568b6a528058, volume: 68c9a4da-8487-4f21-8bff-19c11910a174, {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 09:53:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:53:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:53:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:47 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b458e44-2bc7-46e8-972f-105aa1a5d60a]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:53:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.2ddb37d0-628e-4a69-81c4-568b6a528058 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:47 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.2ddb37d0-628e-4a69-81c4-568b6a528058 Jun 24 09:53:47 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:48 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.2ddb37d0-628e-4a69-81c4-568b6a528058" returned: 0 in 0.908s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:48 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca682b43-3a05-488a-af79-6720191f16b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:53:48 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0 {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 09:53:48 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Creating direct copy from snapshot {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 09:53:48 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8febc6-ebdb-4077-a1be-0e35eb43d01f]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:53:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:48 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0 Jun 24 09:53:48 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:48 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] GroupSnapshot 6195cd0d-65b5-4f57-8bf0-2ee9411833bf: creating. Jun 24 09:53:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] Group snapshot 6195cd0d-65b5-4f57-8bf0-2ee9411833bf: creating. {{(pid=93447) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 24 09:53:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:49 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0" returned: 0 in 1.029s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:49 devstack cinder-volume[93447]: DEBUG cinder.utils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Path /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-68c9a4da-8487-4f21-8bff-19c11910a174 not found in is_blk_device check {{(pid=93447) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 09:53:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-68c9a4da-8487-4f21-8bff-19c11910a174 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:49 devstack sudo[103187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-68c9a4da-8487-4f21-8bff-19c11910a174 Jun 24 09:53:49 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:54 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:53:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Flow 'volume_create_manager' (46b52231-b597-4c82-975b-6764c4b45265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:53:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20195100-7d93-475f-a290-1e5cd176fe5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20195100-7d93-475f-a290-1e5cd176fe5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1841297910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea595ac1-f85c-4e85-a208-c125b1f1d309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a27b62b396b41a589a5a43aa1f233dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:53:55Z,use_quota=True,user_id='88508a82decd45ee9c3da18b19633179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ff75e1-2f31-4c8c-81ae-344f2cea0b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ff75e1-2f31-4c8c-81ae-344f2cea0b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b7ccec6-d843-431a-b699-5e547805ad13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b7ccec6-d843-431a-b699-5e547805ad13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea595ac1-f85c-4e85-a208-c125b1f1d309', 'volume_name': 'volume-ea595ac1-f85c-4e85-a208-c125b1f1d309', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbb3268-4afe-4e90-a23a-dd7b288cf3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cbb3268-4afe-4e90-a23a-dd7b288cf3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f531ae-d686-46f6-acf3-60d99457b0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:54 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Volume ea595ac1-f85c-4e85-a208-c125b1f1d309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea595ac1-f85c-4e85-a208-c125b1f1d309', 'volume_size': 1} Jun 24 09:53:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:54 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-68c9a4da-8487-4f21-8bff-19c11910a174" returned: 0 in 5.587s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:54 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f666e4ba-fd6e-448a-9fac-3f39e93a9875]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:53:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:55 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0 Jun 24 09:53:55 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:55 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0" returned: 0 in 0.972s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:55 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0, size 1024.00 MB, duration 5.59 sec, destination /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-68c9a4da-8487-4f21-8bff-19c11910a174 {{(pid=93447) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 09:53:55 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Converted 1024.00 MB image at 183.26 MB/s Jun 24 09:53:55 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-68c9a4da-8487-4f21-8bff-19c11910a174 is being set with open permissions: ugo+rw Jun 24 09:53:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-68c9a4da-8487-4f21-8bff-19c11910a174 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:55 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-68c9a4da-8487-4f21-8bff-19c11910a174 Jun 24 09:53:55 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:56 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-68c9a4da-8487-4f21-8bff-19c11910a174" returned: 0 in 0.646s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:56 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Lock "cinder-quobyte-68c9a4da-8487-4f21-8bff-19c11910a174" released by "_copy_volume_from_snapshot" :: held 9.233s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:53:56 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Acquiring lock "cinder-quobyte-2ddb37d0-628e-4a69-81c4-568b6a528058" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:53:56 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Lock "cinder-quobyte-2ddb37d0-628e-4a69-81c4-568b6a528058" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:53:56 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Deleting offline snapshot 2ddb37d0-628e-4a69-81c4-568b6a528058 of volume ca682b43-3a05-488a-af79-6720191f16b0 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 09:53:56 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] snapshot_file for this snap is: volume-ca682b43-3a05-488a-af79-6720191f16b0.2ddb37d0-628e-4a69-81c4-568b6a528058 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 09:53:56 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0581631-3d4c-4539-8f70-39d3c76ec7de]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:53:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.2ddb37d0-628e-4a69-81c4-568b6a528058 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:56 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.2ddb37d0-628e-4a69-81c4-568b6a528058 Jun 24 09:53:56 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:57 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=91,cinder:DELETE=6,cinder:INSERT=18,cinder:UPDATE=102 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:53:57 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=91,cinder:INSERT=27,cinder:UPDATE=100,cinder:DELETE=8 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:53:57 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:53:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Flow 'volume_create_manager' (2c1f3752-5c74-48cf-ae77-06f3443337bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:53:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (770522d1-d02a-4980-ba89-1e6820e51714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (770522d1-d02a-4980-ba89-1e6820e51714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1330622219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e079bbfc-ec56-408c-8409-8a3fd6227556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13b5d800babb45c9b32c8000f911dbab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:53:57Z,use_quota=True,user_id='590b21c89b8e4d13a40357c810fec7a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7948a9-40c2-433f-96bd-cdc1512a1d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7948a9-40c2-433f-96bd-cdc1512a1d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a62d723-737c-4067-974c-2dcad4cc4fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a62d723-737c-4067-974c-2dcad4cc4fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e079bbfc-ec56-408c-8409-8a3fd6227556', 'volume_name': 'volume-e079bbfc-ec56-408c-8409-8a3fd6227556', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f02f69-5eb7-4995-9a39-93d237fa9bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f02f69-5eb7-4995-9a39-93d237fa9bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872de643-dc06-4ae1-b86d-4f9b2a55894c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:57 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Volume e079bbfc-ec56-408c-8409-8a3fd6227556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e079bbfc-ec56-408c-8409-8a3fd6227556', 'volume_size': 1} Jun 24 09:53:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:53:57 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.2ddb37d0-628e-4a69-81c4-568b6a528058" returned: 0 in 0.801s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:57 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca682b43-3a05-488a-af79-6720191f16b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:53:57 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf9db0a-5a99-4cc4-9bb5-575c5917f5dc]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:53:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:57 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0 Jun 24 09:53:57 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:58 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0" returned: 0 in 0.758s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.2ddb37d0-628e-4a69-81c4-568b6a528058 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:58 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.2ddb37d0-628e-4a69-81c4-568b6a528058 Jun 24 09:53:58 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:58 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.2ddb37d0-628e-4a69-81c4-568b6a528058" returned: 0 in 0.709s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.2ddb37d0-628e-4a69-81c4-568b6a528058 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:58 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.2ddb37d0-628e-4a69-81c4-568b6a528058 Jun 24 09:53:58 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:53:59 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Jun 24 09:53:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0.2ddb37d0-628e-4a69-81c4-568b6a528058" returned: 0 in 0.642s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:53:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Lock "cinder-quobyte-2ddb37d0-628e-4a69-81c4-568b6a528058" released by "_delete_snapshot" :: held 3.004s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:53:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.877s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:53:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.817s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:53:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2900b66-6463-4a4a-9fb1-010161bcd21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68c9a4da-8487-4f21-8bff-19c11910a174', 'volume_size': 2, 'source_volid': 'ca682b43-3a05-488a-af79-6720191f16b0', 'source_volstatus': 'available'}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (726948c0-1fd5-4d0f-a72a-a7306d03812d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:53:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] Creating offline snapshot 0be9254a-9101-4ec4-96fa-9122fbc996c0 of volume 58100ac4-788b-4cdb-9e9a-1b2c237b7970 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 09:53:59 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Volume volume-68c9a4da-8487-4f21-8bff-19c11910a174 (68c9a4da-8487-4f21-8bff-19c11910a174): created successfully Jun 24 09:53:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (726948c0-1fd5-4d0f-a72a-a7306d03812d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:53:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Flow 'volume_create_manager' (a7987440-db3d-42b8-912f-3328f418e237) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:53:59 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c77f5f-2eb6-4558-a78a-6ab58f307a19]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:53:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:53:59 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-e565af5e-2728-49d3-8b13-599d4b90945a tempest-VolumesCloneTest-1196900690 None] Created volume successfully. Jun 24 09:53:59 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970 Jun 24 09:53:59 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:00 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970" returned: 0 in 0.729s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.0be9254a-9101-4ec4-96fa-9122fbc996c0 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:00 devstack sudo[103238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.0be9254a-9101-4ec4-96fa-9122fbc996c0 1G Jun 24 09:54:00 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:00 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7261ee5d-c5c7-48c0-bd47-6a1ac638912c tempest-VolumesCloneTest-1196900690 None] Acquiring lock "cinder-68c9a4da-8487-4f21-8bff-19c11910a174-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:00 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7261ee5d-c5c7-48c0-bd47-6a1ac638912c tempest-VolumesCloneTest-1196900690 None] Lock "cinder-68c9a4da-8487-4f21-8bff-19c11910a174-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:01 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7261ee5d-c5c7-48c0-bd47-6a1ac638912c tempest-VolumesCloneTest-1196900690 None] Acquiring lock "cinder-quobyte-68c9a4da-8487-4f21-8bff-19c11910a174" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:01 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7261ee5d-c5c7-48c0-bd47-6a1ac638912c tempest-VolumesCloneTest-1196900690 None] Lock "cinder-quobyte-68c9a4da-8487-4f21-8bff-19c11910a174" acquired by "delete_volume" :: waited 0.018s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:01 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad829c44-cacc-4d0c-9928-a845c2051a0e]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7261ee5d-c5c7-48c0-bd47-6a1ac638912c tempest-VolumesCloneTest-1196900690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-68c9a4da-8487-4f21-8bff-19c11910a174 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:01 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-68c9a4da-8487-4f21-8bff-19c11910a174 Jun 24 09:54:01 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:01 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.0be9254a-9101-4ec4-96fa-9122fbc996c0 1G" returned: 0 in 0.817s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.0be9254a-9101-4ec4-96fa-9122fbc996c0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:01 devstack sudo[103247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.0be9254a-9101-4ec4-96fa-9122fbc996c0 Jun 24 09:54:01 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:01 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7261ee5d-c5c7-48c0-bd47-6a1ac638912c tempest-VolumesCloneTest-1196900690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-68c9a4da-8487-4f21-8bff-19c11910a174" returned: 0 in 0.770s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7261ee5d-c5c7-48c0-bd47-6a1ac638912c tempest-VolumesCloneTest-1196900690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-68c9a4da-8487-4f21-8bff-19c11910a174 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:01 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-68c9a4da-8487-4f21-8bff-19c11910a174 Jun 24 09:54:01 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:01 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.0be9254a-9101-4ec4-96fa-9122fbc996c0" returned: 0 in 0.699s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:01 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.0be9254a-9101-4ec4-96fa-9122fbc996c0 is being set with open permissions: ugo+rw: NotImplementedError Jun 24 09:54:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.0be9254a-9101-4ec4-96fa-9122fbc996c0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:02 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.0be9254a-9101-4ec4-96fa-9122fbc996c0 Jun 24 09:54:02 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:02 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7261ee5d-c5c7-48c0-bd47-6a1ac638912c tempest-VolumesCloneTest-1196900690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-68c9a4da-8487-4f21-8bff-19c11910a174" returned: 0 in 0.633s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7261ee5d-c5c7-48c0-bd47-6a1ac638912c tempest-VolumesCloneTest-1196900690 None] Lock "cinder-quobyte-68c9a4da-8487-4f21-8bff-19c11910a174" released by "delete_volume" :: held 1.446s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:02 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-7261ee5d-c5c7-48c0-bd47-6a1ac638912c tempest-VolumesCloneTest-1196900690 None] Created reservations ['cf1f3ac3-4aec-4dca-83f4-437318c4d807', '40ead40d-9151-4637-862f-3ef82dd1879b', '245073e7-a413-40c4-a86a-eccd5c29ccdb', 'd88c3b27-09b1-4db4-80be-d4c228204786'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:54:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7261ee5d-c5c7-48c0-bd47-6a1ac638912c tempest-VolumesCloneTest-1196900690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7261ee5d-c5c7-48c0-bd47-6a1ac638912c tempest-VolumesCloneTest-1196900690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:02 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7261ee5d-c5c7-48c0-bd47-6a1ac638912c tempest-VolumesCloneTest-1196900690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:54:02 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7261ee5d-c5c7-48c0-bd47-6a1ac638912c tempest-VolumesCloneTest-1196900690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:54:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7261ee5d-c5c7-48c0-bd47-6a1ac638912c tempest-VolumesCloneTest-1196900690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7261ee5d-c5c7-48c0-bd47-6a1ac638912c tempest-VolumesCloneTest-1196900690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:02 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.0be9254a-9101-4ec4-96fa-9122fbc996c0" returned: 0 in 0.648s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:02 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:54:02 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:02 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.info Jun 24 09:54:02 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:03 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:03 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-90683c9b-d5b2-4029-a1b9-ae5f1174933a tempest-VolumesCloneTest-1196900690 None] Acquiring lock "cinder-ca682b43-3a05-488a-af79-6720191f16b0-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7261ee5d-c5c7-48c0-bd47-6a1ac638912c tempest-VolumesCloneTest-1196900690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.668s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:03 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-7261ee5d-c5c7-48c0-bd47-6a1ac638912c tempest-VolumesCloneTest-1196900690 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:54:03 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-7261ee5d-c5c7-48c0-bd47-6a1ac638912c tempest-VolumesCloneTest-1196900690 None] Deleted volume successfully. Jun 24 09:54:03 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-90683c9b-d5b2-4029-a1b9-ae5f1174933a tempest-VolumesCloneTest-1196900690 None] Lock "cinder-ca682b43-3a05-488a-af79-6720191f16b0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:03 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:03 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7261ee5d-c5c7-48c0-bd47-6a1ac638912c tempest-VolumesCloneTest-1196900690 None] Lock "cinder-68c9a4da-8487-4f21-8bff-19c11910a174-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.info" returned: 0 in 0.668s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:03 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.info is being set with open permissions: ugo+rw: NotImplementedError Jun 24 09:54:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:03 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.info Jun 24 09:54:03 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:03 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-90683c9b-d5b2-4029-a1b9-ae5f1174933a tempest-VolumesCloneTest-1196900690 None] Acquiring lock "cinder-quobyte-ca682b43-3a05-488a-af79-6720191f16b0" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:03 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-90683c9b-d5b2-4029-a1b9-ae5f1174933a tempest-VolumesCloneTest-1196900690 None] Lock "cinder-quobyte-ca682b43-3a05-488a-af79-6720191f16b0" acquired by "delete_volume" :: waited 0.017s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:03 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ab4e42-284d-4793-afaf-822f0087b76e]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-90683c9b-d5b2-4029-a1b9-ae5f1174933a tempest-VolumesCloneTest-1196900690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:03 devstack sudo[103276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0 Jun 24 09:54:03 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:03 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.info" returned: 0 in 0.674s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.349s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:04 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] Creating offline snapshot 35790011-3881-4906-8d86-97e61d87e2c0 of volume a6f42d68-853e-42dc-9bcc-05856e27905e {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 09:54:04 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[de529ac0-8950-490e-a836-f682f6989bf5]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:04 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e Jun 24 09:54:04 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:04 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-90683c9b-d5b2-4029-a1b9-ae5f1174933a tempest-VolumesCloneTest-1196900690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0" returned: 0 in 0.785s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-90683c9b-d5b2-4029-a1b9-ae5f1174933a tempest-VolumesCloneTest-1196900690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:04 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0 Jun 24 09:54:04 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:04 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e" returned: 0 in 0.773s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.35790011-3881-4906-8d86-97e61d87e2c0 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:04 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-90683c9b-d5b2-4029-a1b9-ae5f1174933a tempest-VolumesCloneTest-1196900690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca682b43-3a05-488a-af79-6720191f16b0" returned: 0 in 0.661s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:04 devstack sudo[103291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.35790011-3881-4906-8d86-97e61d87e2c0 1G Jun 24 09:54:04 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:04 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-90683c9b-d5b2-4029-a1b9-ae5f1174933a tempest-VolumesCloneTest-1196900690 None] Lock "cinder-quobyte-ca682b43-3a05-488a-af79-6720191f16b0" released by "delete_volume" :: held 1.514s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:04 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-90683c9b-d5b2-4029-a1b9-ae5f1174933a tempest-VolumesCloneTest-1196900690 None] Created reservations ['cb5f2916-6a0e-4658-999e-12248e7c5b1e', '54437db4-e662-4a64-891e-c3f9867cfc96', '7a3ed596-6184-454f-9845-d51163ea72b5', '6c2bbd4e-f7fa-4070-a8aa-89b2288b504a'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:54:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-90683c9b-d5b2-4029-a1b9-ae5f1174933a tempest-VolumesCloneTest-1196900690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-90683c9b-d5b2-4029-a1b9-ae5f1174933a tempest-VolumesCloneTest-1196900690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:04 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-90683c9b-d5b2-4029-a1b9-ae5f1174933a tempest-VolumesCloneTest-1196900690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:54:05 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-90683c9b-d5b2-4029-a1b9-ae5f1174933a tempest-VolumesCloneTest-1196900690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:54:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-90683c9b-d5b2-4029-a1b9-ae5f1174933a tempest-VolumesCloneTest-1196900690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-90683c9b-d5b2-4029-a1b9-ae5f1174933a tempest-VolumesCloneTest-1196900690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:05 devstack sudo[103293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:54:05 devstack sudo[103293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:05 devstack sudo[103293]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-90683c9b-d5b2-4029-a1b9-ae5f1174933a tempest-VolumesCloneTest-1196900690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.677s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:05 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-90683c9b-d5b2-4029-a1b9-ae5f1174933a tempest-VolumesCloneTest-1196900690 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:54:05 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-90683c9b-d5b2-4029-a1b9-ae5f1174933a tempest-VolumesCloneTest-1196900690 None] Deleted volume successfully. Jun 24 09:54:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-90683c9b-d5b2-4029-a1b9-ae5f1174933a tempest-VolumesCloneTest-1196900690 None] Lock "cinder-ca682b43-3a05-488a-af79-6720191f16b0-delete_volume" released by "delete_volume" :: held 2.428s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:05 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.35790011-3881-4906-8d86-97e61d87e2c0 1G" returned: 0 in 0.896s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6f42d68-853e-42dc-9bcc-05856e27905e -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.35790011-3881-4906-8d86-97e61d87e2c0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:05 devstack sudo[103300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6f42d68-853e-42dc-9bcc-05856e27905e -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.35790011-3881-4906-8d86-97e61d87e2c0 Jun 24 09:54:05 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:06 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6f42d68-853e-42dc-9bcc-05856e27905e -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.35790011-3881-4906-8d86-97e61d87e2c0" returned: 0 in 0.709s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:06 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.35790011-3881-4906-8d86-97e61d87e2c0 is being set with open permissions: ugo+rw: NotImplementedError Jun 24 09:54:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.35790011-3881-4906-8d86-97e61d87e2c0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:06 devstack sudo[103305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.35790011-3881-4906-8d86-97e61d87e2c0 Jun 24 09:54:06 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:07 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.35790011-3881-4906-8d86-97e61d87e2c0" returned: 0 in 0.698s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:07 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.info Jun 24 09:54:07 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:07 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.info" returned: 0 in 0.628s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:07 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.info is being set with open permissions: ugo+rw: NotImplementedError Jun 24 09:54:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:07 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.info Jun 24 09:54:07 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:08 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.info" returned: 0 in 0.626s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.437s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.081s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1330622219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e079bbfc-ec56-408c-8409-8a3fd6227556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13b5d800babb45c9b32c8000f911dbab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:53:57Z,use_quota=True,user_id='590b21c89b8e4d13a40357c810fec7a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:54:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Creating volume e079bbfc-ec56-408c-8409-8a3fd6227556 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:54:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:54:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:54:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:54:08 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:54:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e079bbfc-ec56-408c-8409-8a3fd6227556 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:08 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:54:08 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e079bbfc-ec56-408c-8409-8a3fd6227556 1073741824 Jun 24 09:54:08 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Flow 'volume_create_manager' (3f8654b3-bebd-4d21-b51f-60a341e4a7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:54:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (424f7f43-d049-4a30-b71d-f364297222a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (424f7f43-d049-4a30-b71d-f364297222a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1685440926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f06d8c-d823-4fe5-bb95-6e86403bf50b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72a54b4b2d7d47a481aed2809637da94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:54:08Z,use_quota=True,user_id='60f02c81ca454d449cc87af85c89e350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f654bc8-cb09-44cd-94d0-cdc7df0deecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f654bc8-cb09-44cd-94d0-cdc7df0deecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65aec2d-7aaa-4ca9-915d-909a30f878cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d65aec2d-7aaa-4ca9-915d-909a30f878cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5f06d8c-d823-4fe5-bb95-6e86403bf50b', 'volume_name': 'volume-f5f06d8c-d823-4fe5-bb95-6e86403bf50b', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3747435a-915b-43cc-8714-e8a8f6a66613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3747435a-915b-43cc-8714-e8a8f6a66613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87288ab-09c0-488b-9130-dde1aa764605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:08 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Volume f5f06d8c-d823-4fe5-bb95-6e86403bf50b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5f06d8c-d823-4fe5-bb95-6e86403bf50b', 'volume_size': 1} Jun 24 09:54:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:08 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-ac1d3e05-7453-41c0-a3bd-2be14de3f315 tempest-GroupSnapshotsTest-344279173 None] group_snapshot 6195cd0d-65b5-4f57-8bf0-2ee9411833bf: created successfully Jun 24 09:54:09 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] group_snapshot 6195cd0d-65b5-4f57-8bf0-2ee9411833bf: deleting Jun 24 09:54:09 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] group_snapshot 6195cd0d-65b5-4f57-8bf0-2ee9411833bf: deleting {{(pid=93447) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 24 09:54:09 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "cinder-quobyte-58100ac4-788b-4cdb-9e9a-1b2c237b7970" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:09 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-58100ac4-788b-4cdb-9e9a-1b2c237b7970" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:09 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "cinder-quobyte-0be9254a-9101-4ec4-96fa-9122fbc996c0" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:09 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-0be9254a-9101-4ec4-96fa-9122fbc996c0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:09 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Deleting offline snapshot 0be9254a-9101-4ec4-96fa-9122fbc996c0 of volume 58100ac4-788b-4cdb-9e9a-1b2c237b7970 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 09:54:09 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] snapshot_file for this snap is: volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.0be9254a-9101-4ec4-96fa-9122fbc996c0 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 09:54:09 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f7cfb9-8016-4084-a7c3-38af2fd2bced]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.0be9254a-9101-4ec4-96fa-9122fbc996c0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:09 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.0be9254a-9101-4ec4-96fa-9122fbc996c0 Jun 24 09:54:09 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:09 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e079bbfc-ec56-408c-8409-8a3fd6227556 1073741824" returned: 0 in 0.956s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e079bbfc-ec56-408c-8409-8a3fd6227556 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:09 devstack sudo[103322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e079bbfc-ec56-408c-8409-8a3fd6227556 Jun 24 09:54:09 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:09 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.0be9254a-9101-4ec4-96fa-9122fbc996c0" returned: 0 in 0.775s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:09 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:54:10 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7403b1ac-44d1-459e-862f-2970d96a823a]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:10 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970 Jun 24 09:54:10 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:10 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e079bbfc-ec56-408c-8409-8a3fd6227556" returned: 0 in 0.688s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:54:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.400s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1841297910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea595ac1-f85c-4e85-a208-c125b1f1d309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a27b62b396b41a589a5a43aa1f233dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:53:55Z,use_quota=True,user_id='88508a82decd45ee9c3da18b19633179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:54:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Creating volume ea595ac1-f85c-4e85-a208-c125b1f1d309 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:54:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:54:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:54:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:54:10 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:54:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea595ac1-f85c-4e85-a208-c125b1f1d309 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872de643-dc06-4ae1-b86d-4f9b2a55894c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e079bbfc-ec56-408c-8409-8a3fd6227556', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:10 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea595ac1-f85c-4e85-a208-c125b1f1d309 1073741824 Jun 24 09:54:10 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc68e156-bf6a-457f-924f-ca2497b4536d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:10 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Volume volume-e079bbfc-ec56-408c-8409-8a3fd6227556 (e079bbfc-ec56-408c-8409-8a3fd6227556): created successfully Jun 24 09:54:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc68e156-bf6a-457f-924f-ca2497b4536d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Flow 'volume_create_manager' (2c1f3752-5c74-48cf-ae77-06f3443337bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:54:10 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-cf260df7-7152-4cbe-8ace-ec28f8e85eb3 tempest-VolumesMetadataTest-1523961322 None] Created volume successfully. Jun 24 09:54:10 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970" returned: 0 in 0.813s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.0be9254a-9101-4ec4-96fa-9122fbc996c0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:10 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.0be9254a-9101-4ec4-96fa-9122fbc996c0 Jun 24 09:54:10 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:11 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea595ac1-f85c-4e85-a208-c125b1f1d309 1073741824" returned: 0 in 0.839s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea595ac1-f85c-4e85-a208-c125b1f1d309 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:11 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea595ac1-f85c-4e85-a208-c125b1f1d309 Jun 24 09:54:11 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:11 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.0be9254a-9101-4ec4-96fa-9122fbc996c0" returned: 0 in 0.888s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.0be9254a-9101-4ec4-96fa-9122fbc996c0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:11 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.0be9254a-9101-4ec4-96fa-9122fbc996c0 Jun 24 09:54:11 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:11 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea595ac1-f85c-4e85-a208-c125b1f1d309" returned: 0 in 0.761s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:11 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:54:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.266s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:11 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1685440926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f06d8c-d823-4fe5-bb95-6e86403bf50b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72a54b4b2d7d47a481aed2809637da94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:54:08Z,use_quota=True,user_id='60f02c81ca454d449cc87af85c89e350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:54:11 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Creating volume f5f06d8c-d823-4fe5-bb95-6e86403bf50b {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:54:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:11 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:54:11 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:54:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:11 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:54:11 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:54:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f5f06d8c-d823-4fe5-bb95-6e86403bf50b 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:11 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a16f4cfe-cedd-49f4-bf29-53252c619461 tempest-VolumesMetadataTest-1523961322 None] Acquiring lock "cinder-e079bbfc-ec56-408c-8409-8a3fd6227556-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:11 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f5f06d8c-d823-4fe5-bb95-6e86403bf50b 1073741824 Jun 24 09:54:11 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f531ae-d686-46f6-acf3-60d99457b0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea595ac1-f85c-4e85-a208-c125b1f1d309', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ad54c3-7ac7-420d-bd3f-b3efba096554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:11 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Volume volume-ea595ac1-f85c-4e85-a208-c125b1f1d309 (ea595ac1-f85c-4e85-a208-c125b1f1d309): created successfully Jun 24 09:54:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ad54c3-7ac7-420d-bd3f-b3efba096554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Flow 'volume_create_manager' (46b52231-b597-4c82-975b-6764c4b45265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:54:11 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a16f4cfe-cedd-49f4-bf29-53252c619461 tempest-VolumesMetadataTest-1523961322 None] Lock "cinder-e079bbfc-ec56-408c-8409-8a3fd6227556-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:11 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-3aa7cd30-9847-4039-b40d-2593d5536e08 tempest-AttachVolumeTestJSON-524336646 None] Created volume successfully. Jun 24 09:54:11 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a16f4cfe-cedd-49f4-bf29-53252c619461 tempest-VolumesMetadataTest-1523961322 None] Acquiring lock "cinder-quobyte-e079bbfc-ec56-408c-8409-8a3fd6227556" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a16f4cfe-cedd-49f4-bf29-53252c619461 tempest-VolumesMetadataTest-1523961322 None] Lock "cinder-quobyte-e079bbfc-ec56-408c-8409-8a3fd6227556" acquired by "delete_volume" :: waited 0.015s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:12 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2579c09e-af42-4874-b6f5-8c8676102029]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a16f4cfe-cedd-49f4-bf29-53252c619461 tempest-VolumesMetadataTest-1523961322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e079bbfc-ec56-408c-8409-8a3fd6227556 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:12 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e079bbfc-ec56-408c-8409-8a3fd6227556 Jun 24 09:54:12 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:12 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970.0be9254a-9101-4ec4-96fa-9122fbc996c0" returned: 0 in 0.679s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-0be9254a-9101-4ec4-96fa-9122fbc996c0" released by "_delete_snapshot" :: held 3.257s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-58100ac4-788b-4cdb-9e9a-1b2c237b7970" released by "delete_snapshot" :: held 3.282s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "cinder-quobyte-a6f42d68-853e-42dc-9bcc-05856e27905e" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-a6f42d68-853e-42dc-9bcc-05856e27905e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "cinder-quobyte-35790011-3881-4906-8d86-97e61d87e2c0" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-35790011-3881-4906-8d86-97e61d87e2c0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Deleting offline snapshot 35790011-3881-4906-8d86-97e61d87e2c0 of volume a6f42d68-853e-42dc-9bcc-05856e27905e {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 09:54:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] snapshot_file for this snap is: volume-a6f42d68-853e-42dc-9bcc-05856e27905e.35790011-3881-4906-8d86-97e61d87e2c0 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 09:54:12 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[56157371-4ba2-4814-b0e9-589c485173a1]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.35790011-3881-4906-8d86-97e61d87e2c0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:12 devstack sudo[103359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.35790011-3881-4906-8d86-97e61d87e2c0 Jun 24 09:54:12 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:12 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f5f06d8c-d823-4fe5-bb95-6e86403bf50b 1073741824" returned: 0 in 0.968s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f5f06d8c-d823-4fe5-bb95-6e86403bf50b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:12 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a16f4cfe-cedd-49f4-bf29-53252c619461 tempest-VolumesMetadataTest-1523961322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e079bbfc-ec56-408c-8409-8a3fd6227556" returned: 0 in 0.859s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a16f4cfe-cedd-49f4-bf29-53252c619461 tempest-VolumesMetadataTest-1523961322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e079bbfc-ec56-408c-8409-8a3fd6227556 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:12 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f5f06d8c-d823-4fe5-bb95-6e86403bf50b Jun 24 09:54:12 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:12 devstack sudo[103369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e079bbfc-ec56-408c-8409-8a3fd6227556 Jun 24 09:54:12 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:13 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.35790011-3881-4906-8d86-97e61d87e2c0" returned: 0 in 0.812s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6f42d68-853e-42dc-9bcc-05856e27905e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:54:13 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[721cec60-9162-4ca1-ac28-30bc5125a6e9]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:13 devstack sudo[103375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e Jun 24 09:54:13 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:13 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f5f06d8c-d823-4fe5-bb95-6e86403bf50b" returned: 0 in 0.675s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:54:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:13 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a16f4cfe-cedd-49f4-bf29-53252c619461 tempest-VolumesMetadataTest-1523961322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e079bbfc-ec56-408c-8409-8a3fd6227556" returned: 0 in 0.689s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87288ab-09c0-488b-9130-dde1aa764605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5f06d8c-d823-4fe5-bb95-6e86403bf50b', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a9de48-2841-4e2d-96e6-3e2894bdd184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:13 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a16f4cfe-cedd-49f4-bf29-53252c619461 tempest-VolumesMetadataTest-1523961322 None] Lock "cinder-quobyte-e079bbfc-ec56-408c-8409-8a3fd6227556" released by "delete_volume" :: held 1.615s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:13 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Volume volume-f5f06d8c-d823-4fe5-bb95-6e86403bf50b (f5f06d8c-d823-4fe5-bb95-6e86403bf50b): created successfully Jun 24 09:54:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a9de48-2841-4e2d-96e6-3e2894bdd184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Flow 'volume_create_manager' (3f8654b3-bebd-4d21-b51f-60a341e4a7ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:54:13 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-b74a317f-c8ea-4188-af7a-4ca0013ca7ae tempest-VolumesListTestJSON-1789822073 None] Created volume successfully. Jun 24 09:54:13 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-a16f4cfe-cedd-49f4-bf29-53252c619461 tempest-VolumesMetadataTest-1523961322 None] Created reservations ['afef09ab-10ca-4eb2-8643-c96e21a0a033', 'c671df49-d231-4876-8669-1acb640d8ac1', 'e44699bb-2990-46ce-b7d9-7e53d447479e', 'ea3cffb7-6a77-4552-a6cd-4ce270f76ec6'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:54:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a16f4cfe-cedd-49f4-bf29-53252c619461 tempest-VolumesMetadataTest-1523961322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a16f4cfe-cedd-49f4-bf29-53252c619461 tempest-VolumesMetadataTest-1523961322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a16f4cfe-cedd-49f4-bf29-53252c619461 tempest-VolumesMetadataTest-1523961322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:54:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a16f4cfe-cedd-49f4-bf29-53252c619461 tempest-VolumesMetadataTest-1523961322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:54:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a16f4cfe-cedd-49f4-bf29-53252c619461 tempest-VolumesMetadataTest-1523961322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a16f4cfe-cedd-49f4-bf29-53252c619461 tempest-VolumesMetadataTest-1523961322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:13 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:54:13 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:14 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e" returned: 0 in 0.860s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.35790011-3881-4906-8d86-97e61d87e2c0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:14 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.35790011-3881-4906-8d86-97e61d87e2c0 Jun 24 09:54:14 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:14 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a16f4cfe-cedd-49f4-bf29-53252c619461 tempest-VolumesMetadataTest-1523961322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.742s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:14 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-a16f4cfe-cedd-49f4-bf29-53252c619461 tempest-VolumesMetadataTest-1523961322 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:54:14 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-a16f4cfe-cedd-49f4-bf29-53252c619461 tempest-VolumesMetadataTest-1523961322 None] Deleted volume successfully. Jun 24 09:54:14 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a16f4cfe-cedd-49f4-bf29-53252c619461 tempest-VolumesMetadataTest-1523961322 None] Lock "cinder-e079bbfc-ec56-408c-8409-8a3fd6227556-delete_volume" released by "delete_volume" :: held 2.622s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:15 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.35790011-3881-4906-8d86-97e61d87e2c0" returned: 0 in 0.873s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.35790011-3881-4906-8d86-97e61d87e2c0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:15 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.35790011-3881-4906-8d86-97e61d87e2c0 Jun 24 09:54:15 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Flow 'volume_create_manager' (0191b59e-af2b-4c3d-a36a-0f2f1f1662cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d4eb16-d1f0-4b51-8d27-fae62ffff334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d4eb16-d1f0-4b51-8d27-fae62ffff334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-526910663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b92e82-676b-422a-b66d-f02fd44becba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72a54b4b2d7d47a481aed2809637da94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:54:16Z,use_quota=True,user_id='60f02c81ca454d449cc87af85c89e350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d04a73e-5963-46d9-ae79-dab578ab3cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d04a73e-5963-46d9-ae79-dab578ab3cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6b0d61-641a-4fe8-a266-91ac2fa87886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6b0d61-641a-4fe8-a266-91ac2fa87886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91b92e82-676b-422a-b66d-f02fd44becba', 'volume_name': 'volume-91b92e82-676b-422a-b66d-f02fd44becba', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6309b6b3-8d20-43f4-9917-66314629eeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6309b6b3-8d20-43f4-9917-66314629eeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6748436c-4679-4bc9-b905-e5fc2086a266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:15 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Volume 91b92e82-676b-422a-b66d-f02fd44becba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91b92e82-676b-422a-b66d-f02fd44becba', 'volume_size': 1} Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-526910663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b92e82-676b-422a-b66d-f02fd44becba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72a54b4b2d7d47a481aed2809637da94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:54:16Z,use_quota=True,user_id='60f02c81ca454d449cc87af85c89e350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Creating volume 91b92e82-676b-422a-b66d-f02fd44becba {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:54:15 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-91b92e82-676b-422a-b66d-f02fd44becba 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:15 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-91b92e82-676b-422a-b66d-f02fd44becba 1073741824 Jun 24 09:54:15 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:15 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e.35790011-3881-4906-8d86-97e61d87e2c0" returned: 0 in 0.850s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:16 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-35790011-3881-4906-8d86-97e61d87e2c0" released by "_delete_snapshot" :: held 3.509s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:16 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-a6f42d68-853e-42dc-9bcc-05856e27905e" released by "delete_snapshot" :: held 3.538s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:16 devstack cinder-volume[93447]: WARNING cinder.quota [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-970660101 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-970660101, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:54:16 devstack cinder-volume[93447]: WARNING cinder.quota [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-970660101 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-970660101, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:54:16 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Created reservations ['3df6a1b9-8272-44c1-9284-383ec31b9645', 'f44ebd92-18a8-4deb-b851-b6401a6f3dad', '24041a6f-99f9-4b83-b8c3-f7cdddb308e2', '1e99111a-ef16-47d3-9ea7-5fbcc5839219'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:54:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-2d2a3c49-c339-4e28-8d94-0eae255cdeb0 req-9f3abf32-f578-4db8-9ef5-efab3ca6669e tempest-AttachVolumeTestJSON-524336646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:16 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] Created reservations ['edd6f423-190f-41d7-a0ea-880fb072dbbd', '86e6a492-0a5a-4fb9-ab66-c2daecb0b878', 'dd8e35ab-c008-4e4d-aa84-a120badd48a1', 'f1169d22-c01e-415c-8947-85b386c8ad7c'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:54:16 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-c08aa025-14b4-40d9-a69c-73d95a6861c0 tempest-GroupSnapshotsTest-344279173 None] group_snapshot 6195cd0d-65b5-4f57-8bf0-2ee9411833bf: deleted successfully Jun 24 09:54:16 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-91b92e82-676b-422a-b66d-f02fd44becba 1073741824" returned: 0 in 0.938s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-91b92e82-676b-422a-b66d-f02fd44becba {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:16 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-91b92e82-676b-422a-b66d-f02fd44becba Jun 24 09:54:16 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:17 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-91b92e82-676b-422a-b66d-f02fd44becba" returned: 0 in 0.663s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-2d2a3c49-c339-4e28-8d94-0eae255cdeb0 req-9f3abf32-f578-4db8-9ef5-efab3ca6669e tempest-AttachVolumeTestJSON-524336646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.119s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6748436c-4679-4bc9-b905-e5fc2086a266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91b92e82-676b-422a-b66d-f02fd44becba', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72dfd448-c7be-41ce-82ed-1e21fe39a214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc457b7-6855-4bfa-a778-664fa6607d7b]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-2d2a3c49-c339-4e28-8d94-0eae255cdeb0 req-9f3abf32-f578-4db8-9ef5-efab3ca6669e tempest-AttachVolumeTestJSON-524336646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea595ac1-f85c-4e85-a208-c125b1f1d309 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:17 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Volume volume-91b92e82-676b-422a-b66d-f02fd44becba (91b92e82-676b-422a-b66d-f02fd44becba): created successfully Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72dfd448-c7be-41ce-82ed-1e21fe39a214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Flow 'volume_create_manager' (0191b59e-af2b-4c3d-a36a-0f2f1f1662cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Flow 'volume_create_manager' (4b5f5229-9994-4a6b-a9fc-8c57fcb737e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c90f6d-fdc2-4524-b101-0aaae1466c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:17 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-d6e66ff7-a80b-4ce6-a12f-063759a75237 tempest-VolumesListTestJSON-1789822073 None] Created volume successfully. Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c90f6d-fdc2-4524-b101-0aaae1466c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-302010624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6293e50b-72f9-4bad-ad6c-6e492229af34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d29c6f38ac4e369746799a859d7d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:54:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:54:17Z,use_quota=True,user_id='118eded35606463a89c9bb1b331581dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37551a59-0997-428c-8999-b3f03ee9ec4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:17 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea595ac1-f85c-4e85-a208-c125b1f1d309 Jun 24 09:54:17 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37551a59-0997-428c-8999-b3f03ee9ec4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49418f8-ea26-4733-9706-9c0c71a1a25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49418f8-ea26-4733-9706-9c0c71a1a25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6293e50b-72f9-4bad-ad6c-6e492229af34', 'volume_name': 'volume-6293e50b-72f9-4bad-ad6c-6e492229af34', 'volume_size': 2}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62ea72e-304f-4a3f-8827-bf537afa133d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62ea72e-304f-4a3f-8827-bf537afa133d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c50a3f1-0c54-4019-b2fc-c86f70aac0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:17 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Volume 6293e50b-72f9-4bad-ad6c-6e492229af34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6293e50b-72f9-4bad-ad6c-6e492229af34', 'volume_size': 2} Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "cinder-quobyte-58100ac4-788b-4cdb-9e9a-1b2c237b7970" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-58100ac4-788b-4cdb-9e9a-1b2c237b7970" acquired by "delete_volume" :: waited 0.021s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f1125d-1809-456b-a228-4ee88d7e9852]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:18 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970 Jun 24 09:54:18 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:18 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-2d2a3c49-c339-4e28-8d94-0eae255cdeb0 req-9f3abf32-f578-4db8-9ef5-efab3ca6669e tempest-AttachVolumeTestJSON-524336646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea595ac1-f85c-4e85-a208-c125b1f1d309" returned: 0 in 0.828s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-2d2a3c49-c339-4e28-8d94-0eae255cdeb0 req-9f3abf32-f578-4db8-9ef5-efab3ca6669e tempest-AttachVolumeTestJSON-524336646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.861s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.673s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-302010624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6293e50b-72f9-4bad-ad6c-6e492229af34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d29c6f38ac4e369746799a859d7d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:54:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:54:17Z,use_quota=True,user_id='118eded35606463a89c9bb1b331581dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Creating volume 6293e50b-72f9-4bad-ad6c-6e492229af34 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:54:18 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6293e50b-72f9-4bad-ad6c-6e492229af34 2147483648 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:18 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6293e50b-72f9-4bad-ad6c-6e492229af34 2147483648 Jun 24 09:54:18 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-2d2a3c49-c339-4e28-8d94-0eae255cdeb0 req-9f3abf32-f578-4db8-9ef5-efab3ca6669e tempest-AttachVolumeTestJSON-524336646 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb', 'name': 'volume-ea595ac1-f85c-4e85-a208-c125b1f1d309', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c6ff9906-a704-4dd4-b33f-d4e6619da702', 'enforce_multipath': True} {{(pid=93447) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 09:54:18 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-2d2a3c49-c339-4e28-8d94-0eae255cdeb0 req-9f3abf32-f578-4db8-9ef5-efab3ca6669e tempest-AttachVolumeTestJSON-524336646 None] attachment_update completed successfully. Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Flow 'volume_create_manager' (eb191e5b-b4a7-4bd8-b7e7-a382fc0af9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065f61bc-bf01-42ce-9869-dc3beb1a0c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (065f61bc-bf01-42ce-9869-dc3beb1a0c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-989245903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ccc96c4-df17-4f96-a31b-f8cfc96f848b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72a54b4b2d7d47a481aed2809637da94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:54:19Z,use_quota=True,user_id='60f02c81ca454d449cc87af85c89e350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7244f37-5061-4811-82c5-f82c9d90eaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7244f37-5061-4811-82c5-f82c9d90eaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a76305-d75d-4796-b90e-5ba1cc405fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a76305-d75d-4796-b90e-5ba1cc405fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ccc96c4-df17-4f96-a31b-f8cfc96f848b', 'volume_name': 'volume-7ccc96c4-df17-4f96-a31b-f8cfc96f848b', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6199d8-18f2-41b1-b336-58c54963c8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6199d8-18f2-41b1-b336-58c54963c8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6867bc-9481-420f-b61f-dc16457c0fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:18 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Volume 7ccc96c4-df17-4f96-a31b-f8cfc96f848b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ccc96c4-df17-4f96-a31b-f8cfc96f848b', 'volume_size': 1} Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:18 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970" returned: 0 in 0.824s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:18 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970 Jun 24 09:54:18 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:19 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6293e50b-72f9-4bad-ad6c-6e492229af34 2147483648" returned: 0 in 1.035s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6293e50b-72f9-4bad-ad6c-6e492229af34 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:19 devstack sudo[103496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6293e50b-72f9-4bad-ad6c-6e492229af34 Jun 24 09:54:19 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:19 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58100ac4-788b-4cdb-9e9a-1b2c237b7970" returned: 0 in 0.708s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:19 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-58100ac4-788b-4cdb-9e9a-1b2c237b7970" released by "delete_volume" :: held 1.604s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:19 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "cinder-quobyte-a6f42d68-853e-42dc-9bcc-05856e27905e" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:19 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-a6f42d68-853e-42dc-9bcc-05856e27905e" acquired by "delete_volume" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:19 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ac3561-33f6-4a37-9750-1ddd6fa66c3d]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:19 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e Jun 24 09:54:19 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:20 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6293e50b-72f9-4bad-ad6c-6e492229af34" returned: 0 in 0.709s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:20 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:54:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.375s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:20 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:54:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-989245903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ccc96c4-df17-4f96-a31b-f8cfc96f848b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72a54b4b2d7d47a481aed2809637da94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:54:19Z,use_quota=True,user_id='60f02c81ca454d449cc87af85c89e350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:54:20 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Creating volume 7ccc96c4-df17-4f96-a31b-f8cfc96f848b {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:54:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:20 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:54:20 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:54:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:20 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:54:20 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:54:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7ccc96c4-df17-4f96-a31b-f8cfc96f848b 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:20 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c50a3f1-0c54-4019-b2fc-c86f70aac0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6293e50b-72f9-4bad-ad6c-6e492229af34', 'volume_size': 2}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:20 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c776456-3527-49f7-abb4-ca4eed3c59ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:20 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7ccc96c4-df17-4f96-a31b-f8cfc96f848b 1073741824 Jun 24 09:54:20 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:20 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Volume volume-6293e50b-72f9-4bad-ad6c-6e492229af34 (6293e50b-72f9-4bad-ad6c-6e492229af34): created successfully Jun 24 09:54:20 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c776456-3527-49f7-abb4-ca4eed3c59ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:20 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Flow 'volume_create_manager' (4b5f5229-9994-4a6b-a9fc-8c57fcb737e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:54:20 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-55883ec1-6f11-4281-a21f-2ed0ee1c9827 tempest-VolumesCloneNegativeTest-696821586 None] Created volume successfully. Jun 24 09:54:20 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e" returned: 0 in 0.961s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:20 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e Jun 24 09:54:20 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-172e674a-3b7d-4da6-a92b-f1ad5d75718f tempest-VolumesCloneNegativeTest-696821586 None] Acquiring lock "cinder-6293e50b-72f9-4bad-ad6c-6e492229af34-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-172e674a-3b7d-4da6-a92b-f1ad5d75718f tempest-VolumesCloneNegativeTest-696821586 None] Lock "cinder-6293e50b-72f9-4bad-ad6c-6e492229af34-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:21 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7ccc96c4-df17-4f96-a31b-f8cfc96f848b 1073741824" returned: 0 in 0.970s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-172e674a-3b7d-4da6-a92b-f1ad5d75718f tempest-VolumesCloneNegativeTest-696821586 None] Acquiring lock "cinder-quobyte-6293e50b-72f9-4bad-ad6c-6e492229af34" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7ccc96c4-df17-4f96-a31b-f8cfc96f848b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-172e674a-3b7d-4da6-a92b-f1ad5d75718f tempest-VolumesCloneNegativeTest-696821586 None] Lock "cinder-quobyte-6293e50b-72f9-4bad-ad6c-6e492229af34" acquired by "delete_volume" :: waited 0.035s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:21 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7ccc96c4-df17-4f96-a31b-f8cfc96f848b Jun 24 09:54:21 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7792b4ca-2ff7-43e0-ac28-ef8bbb3f4cce]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-172e674a-3b7d-4da6-a92b-f1ad5d75718f tempest-VolumesCloneNegativeTest-696821586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6293e50b-72f9-4bad-ad6c-6e492229af34 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:21 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a6f42d68-853e-42dc-9bcc-05856e27905e" returned: 0 in 0.762s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:21 devstack sudo[103868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6293e50b-72f9-4bad-ad6c-6e492229af34 Jun 24 09:54:21 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-a6f42d68-853e-42dc-9bcc-05856e27905e" released by "delete_volume" :: held 1.804s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] Created reservations ['0f3a390c-4b87-4a7b-a2a4-ae54a302eb7c'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:54:21 devstack cinder-volume[93447]: WARNING cinder.quota [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-970660101 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-970660101, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] Created reservations ['eb8feaab-2834-45c7-949b-52f19c54f99d', 'ffad909c-ec9a-4104-adb4-63618fcbabf3', '154d9083-6bd4-4fca-8522-48401dda9eb2', 'e9bdab8c-1033-4a0c-913f-139acbbbae64'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] Created reservations ['c9bcfd17-5908-4ccb-b9e5-23b3b61432d5', '2baaa959-f971-4362-903b-b5e4970c17c1', '9db41d65-9b2d-40df-8a44-cf6d02c718b6', 'd2e79f07-38fe-4714-9b28-7cfa3d31619d'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:21 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:54:21 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:21 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7ccc96c4-df17-4f96-a31b-f8cfc96f848b" returned: 0 in 0.707s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6867bc-9481-420f-b61f-dc16457c0fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ccc96c4-df17-4f96-a31b-f8cfc96f848b', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636f86e6-6e8e-42e8-8732-16e3d8628a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:21 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Volume volume-7ccc96c4-df17-4f96-a31b-f8cfc96f848b (7ccc96c4-df17-4f96-a31b-f8cfc96f848b): created successfully Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636f86e6-6e8e-42e8-8732-16e3d8628a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Flow 'volume_create_manager' (eb191e5b-b4a7-4bd8-b7e7-a382fc0af9db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:54:21 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-1a98a563-264d-4846-8c31-03bda144d38c tempest-VolumesListTestJSON-1789822073 None] Created volume successfully. Jun 24 09:54:22 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-172e674a-3b7d-4da6-a92b-f1ad5d75718f tempest-VolumesCloneNegativeTest-696821586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6293e50b-72f9-4bad-ad6c-6e492229af34" returned: 0 in 0.863s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-172e674a-3b7d-4da6-a92b-f1ad5d75718f tempest-VolumesCloneNegativeTest-696821586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6293e50b-72f9-4bad-ad6c-6e492229af34 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:22 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6293e50b-72f9-4bad-ad6c-6e492229af34 Jun 24 09:54:22 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:22 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.685s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:22 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:54:22 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-d8ac4f27-8630-4fff-898a-0e212a010beb tempest-GroupSnapshotsTest-344279173 None] Delete group completed successfully. Jun 24 09:54:22 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-172e674a-3b7d-4da6-a92b-f1ad5d75718f tempest-VolumesCloneNegativeTest-696821586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6293e50b-72f9-4bad-ad6c-6e492229af34" returned: 0 in 0.681s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:22 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-172e674a-3b7d-4da6-a92b-f1ad5d75718f tempest-VolumesCloneNegativeTest-696821586 None] Lock "cinder-quobyte-6293e50b-72f9-4bad-ad6c-6e492229af34" released by "delete_volume" :: held 1.588s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:22 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-172e674a-3b7d-4da6-a92b-f1ad5d75718f tempest-VolumesCloneNegativeTest-696821586 None] Created reservations ['78f70e8b-060d-49b7-b648-0a7a23774230', '10b7487c-dfb9-4417-81bd-ebd7fbe07023', '10c0c2c2-3b64-497f-9a39-d51cdef1664f', '94b63c41-6292-4e8b-bab5-5796624bcb40'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:54:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-172e674a-3b7d-4da6-a92b-f1ad5d75718f tempest-VolumesCloneNegativeTest-696821586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-172e674a-3b7d-4da6-a92b-f1ad5d75718f tempest-VolumesCloneNegativeTest-696821586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:22 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-172e674a-3b7d-4da6-a92b-f1ad5d75718f tempest-VolumesCloneNegativeTest-696821586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:54:22 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-172e674a-3b7d-4da6-a92b-f1ad5d75718f tempest-VolumesCloneNegativeTest-696821586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:54:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-172e674a-3b7d-4da6-a92b-f1ad5d75718f tempest-VolumesCloneNegativeTest-696821586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-172e674a-3b7d-4da6-a92b-f1ad5d75718f tempest-VolumesCloneNegativeTest-696821586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:22 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:54:22 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:23 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-096f9092-5d4b-4f09-81ee-8fcff7de130d tempest-GroupSnapshotsTest-344279173 None] Group tempest-GroupSnapshotsTest-Group-1688477540: creating Jun 24 09:54:23 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-096f9092-5d4b-4f09-81ee-8fcff7de130d tempest-GroupSnapshotsTest-344279173 None] Group tempest-GroupSnapshotsTest-Group-1688477540: created successfully Jun 24 09:54:23 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-096f9092-5d4b-4f09-81ee-8fcff7de130d tempest-GroupSnapshotsTest-344279173 None] Create group completed successfully. Jun 24 09:54:23 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-172e674a-3b7d-4da6-a92b-f1ad5d75718f tempest-VolumesCloneNegativeTest-696821586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.871s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:23 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-172e674a-3b7d-4da6-a92b-f1ad5d75718f tempest-VolumesCloneNegativeTest-696821586 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:54:23 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-172e674a-3b7d-4da6-a92b-f1ad5d75718f tempest-VolumesCloneNegativeTest-696821586 None] Deleted volume successfully. Jun 24 09:54:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-172e674a-3b7d-4da6-a92b-f1ad5d75718f tempest-VolumesCloneNegativeTest-696821586 None] Lock "cinder-6293e50b-72f9-4bad-ad6c-6e492229af34-delete_volume" released by "delete_volume" :: held 2.774s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:23 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:54:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Flow 'volume_create_manager' (2770e092-f0c5-4318-97b2-0529862bb048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:54:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c570c1c8-a82b-46ab-b9c9-b740b941e845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c570c1c8-a82b-46ab-b9c9-b740b941e845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1121511352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94acd701-0309-42e3-9aad-2dbdc33e9892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a27b62b396b41a589a5a43aa1f233dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:54:24Z,use_quota=True,user_id='88508a82decd45ee9c3da18b19633179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f13b9fc-f978-4d59-896a-20d8217e27f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f13b9fc-f978-4d59-896a-20d8217e27f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c204901-801f-4b7d-b7b9-3ffb9589101d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c204901-801f-4b7d-b7b9-3ffb9589101d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94acd701-0309-42e3-9aad-2dbdc33e9892', 'volume_name': 'volume-94acd701-0309-42e3-9aad-2dbdc33e9892', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0074b728-0675-4ff3-baf0-35ce2a18380f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0074b728-0675-4ff3-baf0-35ce2a18380f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8bcf958-5059-4241-b8f4-ce9448bb2dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:24 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Volume 94acd701-0309-42e3-9aad-2dbdc33e9892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94acd701-0309-42e3-9aad-2dbdc33e9892', 'volume_size': 1} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1121511352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94acd701-0309-42e3-9aad-2dbdc33e9892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a27b62b396b41a589a5a43aa1f233dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:54:24Z,use_quota=True,user_id='88508a82decd45ee9c3da18b19633179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Creating volume 94acd701-0309-42e3-9aad-2dbdc33e9892 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:54:24 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-94acd701-0309-42e3-9aad-2dbdc33e9892 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:24 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-94acd701-0309-42e3-9aad-2dbdc33e9892 1073741824 Jun 24 09:54:24 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Flow 'volume_create_manager' (ae7ca630-d03f-4578-b76f-ab1f3e8d6a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff99c241-54ae-4203-8a74-03eeffe43d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff99c241-54ae-4203-8a74-03eeffe43d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1974945162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d47f359-1261-434a-b3d4-e143282eede9,host='devstack@QuobyteHD#QuobyteHD',id=5a76e01d-46ba-459f-a700-dff5e30d13a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5915f656abf74a1cb3404bebc6661c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:54:24Z,use_quota=True,user_id='a58a07565744453297920119b253d40c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0456e3bc-6a98-4316-b9e5-f7e9ba26d213),volume_type_id=0456e3bc-6a98-4316-b9e5-f7e9ba26d213)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (362f9b7b-ddca-4198-975f-143b3af4ea4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (362f9b7b-ddca-4198-975f-143b3af4ea4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f04b8b-ce68-4f72-b689-da4b0d4a43e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8f04b8b-ce68-4f72-b689-da4b0d4a43e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a76e01d-46ba-459f-a700-dff5e30d13a3', 'volume_name': 'volume-5a76e01d-46ba-459f-a700-dff5e30d13a3', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f492010-4b2a-4757-af1d-4c8dd9f62fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f492010-4b2a-4757-af1d-4c8dd9f62fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4686c3a2-2388-4147-8b3c-7e743e0a23e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:24 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Volume 5a76e01d-46ba-459f-a700-dff5e30d13a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a76e01d-46ba-459f-a700-dff5e30d13a3', 'volume_size': 1} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:54:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:54:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:25 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:54:25 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:25 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-94acd701-0309-42e3-9aad-2dbdc33e9892 1073741824" returned: 0 in 1.270s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-94acd701-0309-42e3-9aad-2dbdc33e9892 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:25 devstack sudo[103892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-94acd701-0309-42e3-9aad-2dbdc33e9892 Jun 24 09:54:25 devstack sudo[103892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:25 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.905s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:54:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:54:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 8 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 09:54:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 09:54:26 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-14d36124-e89d-4d7d-b4fd-8362038203a4 tempest-VolumesListTestJSON-1789822073 None] Acquiring lock "cinder-7ccc96c4-df17-4f96-a31b-f8cfc96f848b-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:26 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-14d36124-e89d-4d7d-b4fd-8362038203a4 tempest-VolumesListTestJSON-1789822073 None] Lock "cinder-7ccc96c4-df17-4f96-a31b-f8cfc96f848b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:26 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-14d36124-e89d-4d7d-b4fd-8362038203a4 tempest-VolumesListTestJSON-1789822073 None] Acquiring lock "cinder-quobyte-7ccc96c4-df17-4f96-a31b-f8cfc96f848b" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:26 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-14d36124-e89d-4d7d-b4fd-8362038203a4 tempest-VolumesListTestJSON-1789822073 None] Lock "cinder-quobyte-7ccc96c4-df17-4f96-a31b-f8cfc96f848b" acquired by "delete_volume" :: waited 0.019s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:26 devstack sudo[103892]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-94acd701-0309-42e3-9aad-2dbdc33e9892" returned: 0 in 0.837s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] <== create_volume: return (2189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:54:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.192s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.464s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5d47f359-1261-434a-b3d4-e143282eede9,created_at=2026-06-24T07:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1974945162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d47f359-1261-434a-b3d4-e143282eede9,host='devstack@QuobyteHD#QuobyteHD',id=5a76e01d-46ba-459f-a700-dff5e30d13a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5915f656abf74a1cb3404bebc6661c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:54:24Z,use_quota=True,user_id='a58a07565744453297920119b253d40c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0456e3bc-6a98-4316-b9e5-f7e9ba26d213),volume_type_id=0456e3bc-6a98-4316-b9e5-f7e9ba26d213)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:54:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Creating volume 5a76e01d-46ba-459f-a700-dff5e30d13a3 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:54:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:54:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:54:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:54:26 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:54:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:26 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d544849-bab8-4909-8aec-5252817f6c9f]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-14d36124-e89d-4d7d-b4fd-8362038203a4 tempest-VolumesListTestJSON-1789822073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7ccc96c4-df17-4f96-a31b-f8cfc96f848b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:26 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3 1073741824 Jun 24 09:54:26 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8bcf958-5059-4241-b8f4-ce9448bb2dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94acd701-0309-42e3-9aad-2dbdc33e9892', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5bdcdb2-4059-434d-bcfe-3950ccb90262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:26 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Volume volume-94acd701-0309-42e3-9aad-2dbdc33e9892 (94acd701-0309-42e3-9aad-2dbdc33e9892): created successfully Jun 24 09:54:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5bdcdb2-4059-434d-bcfe-3950ccb90262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Flow 'volume_create_manager' (2770e092-f0c5-4318-97b2-0529862bb048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:54:26 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-ac2a0e94-ec35-4616-b767-e2aab8fb67ed tempest-AttachVolumeTestJSON-524336646 None] Created volume successfully. Jun 24 09:54:26 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7ccc96c4-df17-4f96-a31b-f8cfc96f848b Jun 24 09:54:26 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:27 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-14d36124-e89d-4d7d-b4fd-8362038203a4 tempest-VolumesListTestJSON-1789822073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7ccc96c4-df17-4f96-a31b-f8cfc96f848b" returned: 0 in 0.890s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-14d36124-e89d-4d7d-b4fd-8362038203a4 tempest-VolumesListTestJSON-1789822073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7ccc96c4-df17-4f96-a31b-f8cfc96f848b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:27 devstack sudo[103908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7ccc96c4-df17-4f96-a31b-f8cfc96f848b Jun 24 09:54:27 devstack sudo[103908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:27 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3 1073741824" returned: 0 in 0.980s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:27 devstack sudo[103912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3 Jun 24 09:54:27 devstack sudo[103912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Flow 'volume_create_manager' (6e7a168f-cc74-4485-81e3-a2a4c8fc5ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95e9432-5a38-4ad2-9930-b6eb99d46180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95e9432-5a38-4ad2-9930-b6eb99d46180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-571419280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3087c6af-9bec-4f22-bf86-e0539a87150e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1cf94bf08bf443c0a23eaf5ac03f0314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:54:27Z,use_quota=True,user_id='1808a15ca11b48ba8257f8fe9f81df6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (732008cc-7e22-47a9-a010-c1395132ef25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (732008cc-7e22-47a9-a010-c1395132ef25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c1a06f-b5bc-44cf-bee9-bc9174788fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c1a06f-b5bc-44cf-bee9-bc9174788fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3087c6af-9bec-4f22-bf86-e0539a87150e', 'volume_name': 'volume-3087c6af-9bec-4f22-bf86-e0539a87150e', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ac764f-99bb-409b-8c7b-e8c9bfb6cdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ac764f-99bb-409b-8c7b-e8c9bfb6cdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f34ff3b0-b97a-45b4-b82b-01cb821ef51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:27 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Volume 3087c6af-9bec-4f22-bf86-e0539a87150e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3087c6af-9bec-4f22-bf86-e0539a87150e', 'volume_size': 1} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:27 devstack sudo[103908]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-14d36124-e89d-4d7d-b4fd-8362038203a4 tempest-VolumesListTestJSON-1789822073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7ccc96c4-df17-4f96-a31b-f8cfc96f848b" returned: 0 in 0.753s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-14d36124-e89d-4d7d-b4fd-8362038203a4 tempest-VolumesListTestJSON-1789822073 None] Lock "cinder-quobyte-7ccc96c4-df17-4f96-a31b-f8cfc96f848b" released by "delete_volume" :: held 1.704s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:27 devstack sudo[103912]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3" returned: 0 in 0.668s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.418s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-571419280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3087c6af-9bec-4f22-bf86-e0539a87150e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1cf94bf08bf443c0a23eaf5ac03f0314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:54:27Z,use_quota=True,user_id='1808a15ca11b48ba8257f8fe9f81df6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Creating volume 3087c6af-9bec-4f22-bf86-e0539a87150e {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:54:27 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3087c6af-9bec-4f22-bf86-e0539a87150e 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:27 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3087c6af-9bec-4f22-bf86-e0539a87150e 1073741824 Jun 24 09:54:27 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4686c3a2-2388-4147-8b3c-7e743e0a23e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a76e01d-46ba-459f-a700-dff5e30d13a3', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18119949-09a8-44c7-8fc4-4b051dfe99b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:28 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-14d36124-e89d-4d7d-b4fd-8362038203a4 tempest-VolumesListTestJSON-1789822073 None] Created reservations ['936a1437-9145-46bf-8d4b-3d5b109eb6a4', '22c0d7d0-97a1-4c04-9f3e-ded88f796cf0', '7a45b6ed-69cc-4940-add9-dccb435fc61d', 'ea65dbe0-816e-49f9-97c9-15700ef87ff3'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:54:28 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Volume volume-5a76e01d-46ba-459f-a700-dff5e30d13a3 (5a76e01d-46ba-459f-a700-dff5e30d13a3): created successfully Jun 24 09:54:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18119949-09a8-44c7-8fc4-4b051dfe99b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Flow 'volume_create_manager' (ae7ca630-d03f-4578-b76f-ab1f3e8d6a87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:54:28 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-af6883b9-ab2f-4eaa-b6e1-818b4934e262 tempest-GroupSnapshotsTest-344279173 None] Created volume successfully. Jun 24 09:54:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-14d36124-e89d-4d7d-b4fd-8362038203a4 tempest-VolumesListTestJSON-1789822073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-14d36124-e89d-4d7d-b4fd-8362038203a4 tempest-VolumesListTestJSON-1789822073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:28 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-14d36124-e89d-4d7d-b4fd-8362038203a4 tempest-VolumesListTestJSON-1789822073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:54:28 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-14d36124-e89d-4d7d-b4fd-8362038203a4 tempest-VolumesListTestJSON-1789822073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:54:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-14d36124-e89d-4d7d-b4fd-8362038203a4 tempest-VolumesListTestJSON-1789822073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-14d36124-e89d-4d7d-b4fd-8362038203a4 tempest-VolumesListTestJSON-1789822073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:28 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:54:28 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:28 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1f085ee7-b113-4141-a1ad-f74fe02f2c77 tempest-VolumesListTestJSON-1789822073 None] Acquiring lock "cinder-91b92e82-676b-422a-b66d-f02fd44becba-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:28 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1f085ee7-b113-4141-a1ad-f74fe02f2c77 tempest-VolumesListTestJSON-1789822073 None] Lock "cinder-91b92e82-676b-422a-b66d-f02fd44becba-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:28 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-f9592dda-eb1e-4a7d-9b9d-beb7f471a5ce tempest-GroupSnapshotsTest-344279173 None] GroupSnapshot 59bbaa38-0cdb-4614-8488-b3e12c290964: creating. Jun 24 09:54:28 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1f085ee7-b113-4141-a1ad-f74fe02f2c77 tempest-VolumesListTestJSON-1789822073 None] Acquiring lock "cinder-quobyte-91b92e82-676b-422a-b66d-f02fd44becba" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:28 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1f085ee7-b113-4141-a1ad-f74fe02f2c77 tempest-VolumesListTestJSON-1789822073 None] Lock "cinder-quobyte-91b92e82-676b-422a-b66d-f02fd44becba" acquired by "delete_volume" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f9592dda-eb1e-4a7d-9b9d-beb7f471a5ce tempest-GroupSnapshotsTest-344279173 None] Group snapshot 59bbaa38-0cdb-4614-8488-b3e12c290964: creating. {{(pid=93447) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 24 09:54:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f9592dda-eb1e-4a7d-9b9d-beb7f471a5ce tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:28 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00cd643-12ab-4547-90c0-11b7d2bcf927]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1f085ee7-b113-4141-a1ad-f74fe02f2c77 tempest-VolumesListTestJSON-1789822073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-91b92e82-676b-422a-b66d-f02fd44becba {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:28 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-91b92e82-676b-422a-b66d-f02fd44becba Jun 24 09:54:28 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:28 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3087c6af-9bec-4f22-bf86-e0539a87150e 1073741824" returned: 0 in 0.971s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:28 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-14d36124-e89d-4d7d-b4fd-8362038203a4 tempest-VolumesListTestJSON-1789822073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.850s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:28 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-14d36124-e89d-4d7d-b4fd-8362038203a4 tempest-VolumesListTestJSON-1789822073 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:54:28 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-14d36124-e89d-4d7d-b4fd-8362038203a4 tempest-VolumesListTestJSON-1789822073 None] Deleted volume successfully. Jun 24 09:54:28 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-14d36124-e89d-4d7d-b4fd-8362038203a4 tempest-VolumesListTestJSON-1789822073 None] Lock "cinder-7ccc96c4-df17-4f96-a31b-f8cfc96f848b-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3087c6af-9bec-4f22-bf86-e0539a87150e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:29 devstack sudo[103928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3087c6af-9bec-4f22-bf86-e0539a87150e Jun 24 09:54:29 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:29 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1f085ee7-b113-4141-a1ad-f74fe02f2c77 tempest-VolumesListTestJSON-1789822073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-91b92e82-676b-422a-b66d-f02fd44becba" returned: 0 in 0.831s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1f085ee7-b113-4141-a1ad-f74fe02f2c77 tempest-VolumesListTestJSON-1789822073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-91b92e82-676b-422a-b66d-f02fd44becba {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:29 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-91b92e82-676b-422a-b66d-f02fd44becba Jun 24 09:54:29 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:29 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3087c6af-9bec-4f22-bf86-e0539a87150e" returned: 0 in 0.692s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:29 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:54:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f9592dda-eb1e-4a7d-9b9d-beb7f471a5ce tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.003s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:29 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-f9592dda-eb1e-4a7d-9b9d-beb7f471a5ce tempest-GroupSnapshotsTest-344279173 None] Creating offline snapshot 2fd1e80a-8f2d-4c78-9b9f-655171f64477 of volume 5a76e01d-46ba-459f-a700-dff5e30d13a3 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 09:54:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f34ff3b0-b97a-45b4-b82b-01cb821ef51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3087c6af-9bec-4f22-bf86-e0539a87150e', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3dda948-8e06-4107-8b66-d88e9ae5286e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:29 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c41e0e-b763-4d46-91c8-63f88c5466e2]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f9592dda-eb1e-4a7d-9b9d-beb7f471a5ce tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:29 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Volume volume-3087c6af-9bec-4f22-bf86-e0539a87150e (3087c6af-9bec-4f22-bf86-e0539a87150e): created successfully Jun 24 09:54:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3dda948-8e06-4107-8b66-d88e9ae5286e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Flow 'volume_create_manager' (6e7a168f-cc74-4485-81e3-a2a4c8fc5ae3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:54:29 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-2e7065ab-9729-4c4a-9ee4-201da07b5b12 tempest-VolumesGetTest-696686733 None] Created volume successfully. Jun 24 09:54:29 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3 Jun 24 09:54:29 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:30 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1f085ee7-b113-4141-a1ad-f74fe02f2c77 tempest-VolumesListTestJSON-1789822073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-91b92e82-676b-422a-b66d-f02fd44becba" returned: 0 in 0.707s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:30 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1f085ee7-b113-4141-a1ad-f74fe02f2c77 tempest-VolumesListTestJSON-1789822073 None] Lock "cinder-quobyte-91b92e82-676b-422a-b66d-f02fd44becba" released by "delete_volume" :: held 1.589s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:30 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-1f085ee7-b113-4141-a1ad-f74fe02f2c77 tempest-VolumesListTestJSON-1789822073 None] Created reservations ['ca5f6ea5-d6d2-41b1-aa4a-7b0f2eaf4301', '11d2bf17-a98d-4db0-b51a-23284b091dc5', '332e8e3a-27a6-41b9-891c-94ca46f7ec19', '5acdabeb-f5ae-49eb-92b4-96125b5cae50'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:54:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1f085ee7-b113-4141-a1ad-f74fe02f2c77 tempest-VolumesListTestJSON-1789822073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1f085ee7-b113-4141-a1ad-f74fe02f2c77 tempest-VolumesListTestJSON-1789822073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:30 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1f085ee7-b113-4141-a1ad-f74fe02f2c77 tempest-VolumesListTestJSON-1789822073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:54:30 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1f085ee7-b113-4141-a1ad-f74fe02f2c77 tempest-VolumesListTestJSON-1789822073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:54:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1f085ee7-b113-4141-a1ad-f74fe02f2c77 tempest-VolumesListTestJSON-1789822073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1f085ee7-b113-4141-a1ad-f74fe02f2c77 tempest-VolumesListTestJSON-1789822073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:30 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:54:30 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-446419f2-1639-48fb-8e51-59a2febac239 req-51473870-8f5c-4de3-9bdb-b7757d0b2d80 tempest-AttachVolumeTestJSON-524336646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:30 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f9592dda-eb1e-4a7d-9b9d-beb7f471a5ce tempest-GroupSnapshotsTest-344279173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3" returned: 0 in 0.814s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f9592dda-eb1e-4a7d-9b9d-beb7f471a5ce tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.2fd1e80a-8f2d-4c78-9b9f-655171f64477 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:30 devstack sudo[103952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.2fd1e80a-8f2d-4c78-9b9f-655171f64477 1G Jun 24 09:54:30 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:31 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1f085ee7-b113-4141-a1ad-f74fe02f2c77 tempest-VolumesListTestJSON-1789822073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.685s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:31 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-1f085ee7-b113-4141-a1ad-f74fe02f2c77 tempest-VolumesListTestJSON-1789822073 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:54:31 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-1f085ee7-b113-4141-a1ad-f74fe02f2c77 tempest-VolumesListTestJSON-1789822073 None] Deleted volume successfully. Jun 24 09:54:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1f085ee7-b113-4141-a1ad-f74fe02f2c77 tempest-VolumesListTestJSON-1789822073 None] Lock "cinder-91b92e82-676b-422a-b66d-f02fd44becba-delete_volume" released by "delete_volume" :: held 2.569s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-23496088-4802-4ec3-a6d0-d96447ab7b5a tempest-VolumesListTestJSON-1789822073 None] Acquiring lock "cinder-f5f06d8c-d823-4fe5-bb95-6e86403bf50b-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-23496088-4802-4ec3-a6d0-d96447ab7b5a tempest-VolumesListTestJSON-1789822073 None] Lock "cinder-f5f06d8c-d823-4fe5-bb95-6e86403bf50b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-23496088-4802-4ec3-a6d0-d96447ab7b5a tempest-VolumesListTestJSON-1789822073 None] Acquiring lock "cinder-quobyte-f5f06d8c-d823-4fe5-bb95-6e86403bf50b" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-23496088-4802-4ec3-a6d0-d96447ab7b5a tempest-VolumesListTestJSON-1789822073 None] Lock "cinder-quobyte-f5f06d8c-d823-4fe5-bb95-6e86403bf50b" acquired by "delete_volume" :: waited 0.022s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:31 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:54:31 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Flow 'volume_create_manager' (e8e4db8e-ce91-4cf1-8560-344e00c4c697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:54:31 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18bbd4e-3107-4264-83a5-a402fdbb2c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:31 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab216be-1a2f-4168-bd34-dec1e77813b8]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-23496088-4802-4ec3-a6d0-d96447ab7b5a tempest-VolumesListTestJSON-1789822073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f5f06d8c-d823-4fe5-bb95-6e86403bf50b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:31 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18bbd4e-3107-4264-83a5-a402fdbb2c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:54:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2100434573',display_name='tempest-VolumesGetTest-Volume-284676253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca99e9a-ad8e-4180-a86b-75af8d01f37b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf94bf08bf443c0a23eaf5ac03f0314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:54:31Z,use_quota=True,user_id='1808a15ca11b48ba8257f8fe9f81df6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:31 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57afe45f-bafa-4705-8063-1fefc25603d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:31 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57afe45f-bafa-4705-8063-1fefc25603d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:31 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7653456a-7fa2-4831-8628-5909b0bcfff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:31 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7653456a-7fa2-4831-8628-5909b0bcfff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ca99e9a-ad8e-4180-a86b-75af8d01f37b', 'volume_name': 'volume-8ca99e9a-ad8e-4180-a86b-75af8d01f37b', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:31 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5334e9cb-8ff5-4273-ad30-4c841c9793ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:31 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5334e9cb-8ff5-4273-ad30-4c841c9793ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:31 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:31 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8cfc37a-4b19-4034-8f8d-9c34bfd42618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:31 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Volume 8ca99e9a-ad8e-4180-a86b-75af8d01f37b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ca99e9a-ad8e-4180-a86b-75af8d01f37b', 'volume_size': 1} Jun 24 09:54:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f9592dda-eb1e-4a7d-9b9d-beb7f471a5ce tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.2fd1e80a-8f2d-4c78-9b9f-655171f64477 1G" returned: 0 in 0.962s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f9592dda-eb1e-4a7d-9b9d-beb7f471a5ce tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a76e01d-46ba-459f-a700-dff5e30d13a3 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.2fd1e80a-8f2d-4c78-9b9f-655171f64477 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:31 devstack sudo[103961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a76e01d-46ba-459f-a700-dff5e30d13a3 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.2fd1e80a-8f2d-4c78-9b9f-655171f64477 Jun 24 09:54:31 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:31 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f5f06d8c-d823-4fe5-bb95-6e86403bf50b Jun 24 09:54:31 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:32 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-23496088-4802-4ec3-a6d0-d96447ab7b5a tempest-VolumesListTestJSON-1789822073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f5f06d8c-d823-4fe5-bb95-6e86403bf50b" returned: 0 in 0.746s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-23496088-4802-4ec3-a6d0-d96447ab7b5a tempest-VolumesListTestJSON-1789822073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f5f06d8c-d823-4fe5-bb95-6e86403bf50b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:32 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f9592dda-eb1e-4a7d-9b9d-beb7f471a5ce tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a76e01d-46ba-459f-a700-dff5e30d13a3 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.2fd1e80a-8f2d-4c78-9b9f-655171f64477" returned: 0 in 0.694s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:32 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-f9592dda-eb1e-4a7d-9b9d-beb7f471a5ce tempest-GroupSnapshotsTest-344279173 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.2fd1e80a-8f2d-4c78-9b9f-655171f64477 is being set with open permissions: ugo+rw: NotImplementedError Jun 24 09:54:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f9592dda-eb1e-4a7d-9b9d-beb7f471a5ce tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.2fd1e80a-8f2d-4c78-9b9f-655171f64477 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:32 devstack sudo[103971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f5f06d8c-d823-4fe5-bb95-6e86403bf50b Jun 24 09:54:32 devstack sudo[103971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:32 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.2fd1e80a-8f2d-4c78-9b9f-655171f64477 Jun 24 09:54:32 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:32 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f9592dda-eb1e-4a7d-9b9d-beb7f471a5ce tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.2fd1e80a-8f2d-4c78-9b9f-655171f64477" returned: 0 in 0.625s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:32 devstack sudo[103971]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-23496088-4802-4ec3-a6d0-d96447ab7b5a tempest-VolumesListTestJSON-1789822073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f5f06d8c-d823-4fe5-bb95-6e86403bf50b" returned: 0 in 0.649s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:32 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-23496088-4802-4ec3-a6d0-d96447ab7b5a tempest-VolumesListTestJSON-1789822073 None] Lock "cinder-quobyte-f5f06d8c-d823-4fe5-bb95-6e86403bf50b" released by "delete_volume" :: held 1.469s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f9592dda-eb1e-4a7d-9b9d-beb7f471a5ce tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:32 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.info Jun 24 09:54:32 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:32 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-23496088-4802-4ec3-a6d0-d96447ab7b5a tempest-VolumesListTestJSON-1789822073 None] Created reservations ['0f3f0ff8-62d4-473b-99e6-c34e67510d73', 'c4455683-1a39-45ae-ab81-75f08b869e10', 'e3843593-8e39-46c6-99a9-d23baa780490', 'ae8e2f09-b7ea-4473-abce-36b790ac5318'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:54:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-23496088-4802-4ec3-a6d0-d96447ab7b5a tempest-VolumesListTestJSON-1789822073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-23496088-4802-4ec3-a6d0-d96447ab7b5a tempest-VolumesListTestJSON-1789822073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:32 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-23496088-4802-4ec3-a6d0-d96447ab7b5a tempest-VolumesListTestJSON-1789822073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:54:32 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-23496088-4802-4ec3-a6d0-d96447ab7b5a tempest-VolumesListTestJSON-1789822073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:54:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-23496088-4802-4ec3-a6d0-d96447ab7b5a tempest-VolumesListTestJSON-1789822073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-23496088-4802-4ec3-a6d0-d96447ab7b5a tempest-VolumesListTestJSON-1789822073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:33 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:54:33 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:33 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f9592dda-eb1e-4a7d-9b9d-beb7f471a5ce tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.info" returned: 0 in 0.676s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:33 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-f9592dda-eb1e-4a7d-9b9d-beb7f471a5ce tempest-GroupSnapshotsTest-344279173 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.info is being set with open permissions: ugo+rw: NotImplementedError Jun 24 09:54:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f9592dda-eb1e-4a7d-9b9d-beb7f471a5ce tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:33 devstack sudo[103983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.info Jun 24 09:54:33 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:33 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-23496088-4802-4ec3-a6d0-d96447ab7b5a tempest-VolumesListTestJSON-1789822073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.671s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:33 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-23496088-4802-4ec3-a6d0-d96447ab7b5a tempest-VolumesListTestJSON-1789822073 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:54:33 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-23496088-4802-4ec3-a6d0-d96447ab7b5a tempest-VolumesListTestJSON-1789822073 None] Deleted volume successfully. Jun 24 09:54:33 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-23496088-4802-4ec3-a6d0-d96447ab7b5a tempest-VolumesListTestJSON-1789822073 None] Lock "cinder-f5f06d8c-d823-4fe5-bb95-6e86403bf50b-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:34 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f9592dda-eb1e-4a7d-9b9d-beb7f471a5ce tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.info" returned: 0 in 0.676s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f9592dda-eb1e-4a7d-9b9d-beb7f471a5ce tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.570s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-446419f2-1639-48fb-8e51-59a2febac239 req-51473870-8f5c-4de3-9bdb-b7757d0b2d80 tempest-AttachVolumeTestJSON-524336646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.707s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:34 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b53593e-f8d8-4f42-bb58-6c02da7ca007]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-446419f2-1639-48fb-8e51-59a2febac239 req-51473870-8f5c-4de3-9bdb-b7757d0b2d80 tempest-AttachVolumeTestJSON-524336646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-94acd701-0309-42e3-9aad-2dbdc33e9892 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:34 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-f9592dda-eb1e-4a7d-9b9d-beb7f471a5ce tempest-GroupSnapshotsTest-344279173 None] group_snapshot 59bbaa38-0cdb-4614-8488-b3e12c290964: created successfully Jun 24 09:54:34 devstack sudo[103986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-94acd701-0309-42e3-9aad-2dbdc33e9892 Jun 24 09:54:34 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:35 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-dcf10d8f-7304-408e-a340-e7fe5be2746a tempest-GroupSnapshotsTest-344279173 None] group_snapshot 59bbaa38-0cdb-4614-8488-b3e12c290964: deleting Jun 24 09:54:35 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dcf10d8f-7304-408e-a340-e7fe5be2746a tempest-GroupSnapshotsTest-344279173 None] group_snapshot 59bbaa38-0cdb-4614-8488-b3e12c290964: deleting {{(pid=93447) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 24 09:54:35 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-dcf10d8f-7304-408e-a340-e7fe5be2746a tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "cinder-quobyte-5a76e01d-46ba-459f-a700-dff5e30d13a3" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:35 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-dcf10d8f-7304-408e-a340-e7fe5be2746a tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-5a76e01d-46ba-459f-a700-dff5e30d13a3" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:35 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-dcf10d8f-7304-408e-a340-e7fe5be2746a tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "cinder-quobyte-2fd1e80a-8f2d-4c78-9b9f-655171f64477" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:35 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-dcf10d8f-7304-408e-a340-e7fe5be2746a tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-2fd1e80a-8f2d-4c78-9b9f-655171f64477" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:35 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-dcf10d8f-7304-408e-a340-e7fe5be2746a tempest-GroupSnapshotsTest-344279173 None] Deleting offline snapshot 2fd1e80a-8f2d-4c78-9b9f-655171f64477 of volume 5a76e01d-46ba-459f-a700-dff5e30d13a3 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 09:54:35 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:35 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-dcf10d8f-7304-408e-a340-e7fe5be2746a tempest-GroupSnapshotsTest-344279173 None] snapshot_file for this snap is: volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.2fd1e80a-8f2d-4c78-9b9f-655171f64477 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 09:54:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-446419f2-1639-48fb-8e51-59a2febac239 req-51473870-8f5c-4de3-9bdb-b7757d0b2d80 tempest-AttachVolumeTestJSON-524336646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-94acd701-0309-42e3-9aad-2dbdc33e9892" returned: 0 in 1.014s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-446419f2-1639-48fb-8e51-59a2febac239 req-51473870-8f5c-4de3-9bdb-b7757d0b2d80 tempest-AttachVolumeTestJSON-524336646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.056s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.799s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:35 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:54:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2100434573',display_name='tempest-VolumesGetTest-Volume-284676253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca99e9a-ad8e-4180-a86b-75af8d01f37b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf94bf08bf443c0a23eaf5ac03f0314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:54:31Z,use_quota=True,user_id='1808a15ca11b48ba8257f8fe9f81df6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:54:35 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Creating volume 8ca99e9a-ad8e-4180-a86b-75af8d01f37b {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:54:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:35 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:54:35 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:54:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:35 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:54:35 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:54:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ca99e9a-ad8e-4180-a86b-75af8d01f37b 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:35 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1341ea7c-e84b-4445-876c-e8e9f7d520df]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dcf10d8f-7304-408e-a340-e7fe5be2746a tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.2fd1e80a-8f2d-4c78-9b9f-655171f64477 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:35 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ca99e9a-ad8e-4180-a86b-75af8d01f37b 1073741824 Jun 24 09:54:35 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:35 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-446419f2-1639-48fb-8e51-59a2febac239 req-51473870-8f5c-4de3-9bdb-b7757d0b2d80 tempest-AttachVolumeTestJSON-524336646 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb', 'name': 'volume-94acd701-0309-42e3-9aad-2dbdc33e9892', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7586fcc1-7c11-4813-91c2-1be2659f73ef', 'enforce_multipath': True} {{(pid=93447) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 09:54:35 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-446419f2-1639-48fb-8e51-59a2febac239 req-51473870-8f5c-4de3-9bdb-b7757d0b2d80 tempest-AttachVolumeTestJSON-524336646 None] attachment_update completed successfully. Jun 24 09:54:35 devstack sudo[103993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.2fd1e80a-8f2d-4c78-9b9f-655171f64477 Jun 24 09:54:35 devstack sudo[103993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:36 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ca99e9a-ad8e-4180-a86b-75af8d01f37b 1073741824" returned: 0 in 1.017s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:36 devstack sudo[103993]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dcf10d8f-7304-408e-a340-e7fe5be2746a tempest-GroupSnapshotsTest-344279173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.2fd1e80a-8f2d-4c78-9b9f-655171f64477" returned: 0 in 1.011s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-dcf10d8f-7304-408e-a340-e7fe5be2746a tempest-GroupSnapshotsTest-344279173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a76e01d-46ba-459f-a700-dff5e30d13a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:54:36 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fadf8d-cba2-4a0f-b8e6-f428035a9ba4]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dcf10d8f-7304-408e-a340-e7fe5be2746a tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ca99e9a-ad8e-4180-a86b-75af8d01f37b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:36 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ca99e9a-ad8e-4180-a86b-75af8d01f37b Jun 24 09:54:36 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:36 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3 Jun 24 09:54:36 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:37 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ca99e9a-ad8e-4180-a86b-75af8d01f37b" returned: 0 in 0.885s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:37 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] <== create_volume: return (1991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:54:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:37 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dcf10d8f-7304-408e-a340-e7fe5be2746a tempest-GroupSnapshotsTest-344279173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3" returned: 0 in 0.933s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dcf10d8f-7304-408e-a340-e7fe5be2746a tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.2fd1e80a-8f2d-4c78-9b9f-655171f64477 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:37 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8cfc37a-4b19-4034-8f8d-9c34bfd42618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ca99e9a-ad8e-4180-a86b-75af8d01f37b', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:37 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2e5a05-f75b-4428-bd5a-bea107e88d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:37 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.2fd1e80a-8f2d-4c78-9b9f-655171f64477 Jun 24 09:54:37 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Volume volume-8ca99e9a-ad8e-4180-a86b-75af8d01f37b (8ca99e9a-ad8e-4180-a86b-75af8d01f37b): created successfully Jun 24 09:54:37 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:37 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2e5a05-f75b-4428-bd5a-bea107e88d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:37 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Flow 'volume_create_manager' (e8e4db8e-ce91-4cf1-8560-344e00c4c697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:54:37 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-dac432eb-dd09-4692-8930-0c35d758bc19 tempest-VolumesGetTest-696686733 None] Created volume successfully. Jun 24 09:54:38 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3a5388e0-599f-492d-b8ba-98bec6ea087d tempest-VolumesGetTest-696686733 None] Acquiring lock "cinder-8ca99e9a-ad8e-4180-a86b-75af8d01f37b-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:38 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3a5388e0-599f-492d-b8ba-98bec6ea087d tempest-VolumesGetTest-696686733 None] Lock "cinder-8ca99e9a-ad8e-4180-a86b-75af8d01f37b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:38 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3a5388e0-599f-492d-b8ba-98bec6ea087d tempest-VolumesGetTest-696686733 None] Acquiring lock "cinder-quobyte-8ca99e9a-ad8e-4180-a86b-75af8d01f37b" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:38 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3a5388e0-599f-492d-b8ba-98bec6ea087d tempest-VolumesGetTest-696686733 None] Lock "cinder-quobyte-8ca99e9a-ad8e-4180-a86b-75af8d01f37b" acquired by "delete_volume" :: waited 0.023s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:38 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f72a66-5637-44f8-84f3-6a9939ec3e2a]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3a5388e0-599f-492d-b8ba-98bec6ea087d tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ca99e9a-ad8e-4180-a86b-75af8d01f37b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:38 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ca99e9a-ad8e-4180-a86b-75af8d01f37b Jun 24 09:54:38 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:38 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dcf10d8f-7304-408e-a340-e7fe5be2746a tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.2fd1e80a-8f2d-4c78-9b9f-655171f64477" returned: 0 in 0.986s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dcf10d8f-7304-408e-a340-e7fe5be2746a tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.2fd1e80a-8f2d-4c78-9b9f-655171f64477 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:38 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.2fd1e80a-8f2d-4c78-9b9f-655171f64477 Jun 24 09:54:38 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:39 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3a5388e0-599f-492d-b8ba-98bec6ea087d tempest-VolumesGetTest-696686733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ca99e9a-ad8e-4180-a86b-75af8d01f37b" returned: 0 in 0.893s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3a5388e0-599f-492d-b8ba-98bec6ea087d tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ca99e9a-ad8e-4180-a86b-75af8d01f37b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:39 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dcf10d8f-7304-408e-a340-e7fe5be2746a tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3.2fd1e80a-8f2d-4c78-9b9f-655171f64477" returned: 0 in 0.771s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:39 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ca99e9a-ad8e-4180-a86b-75af8d01f37b Jun 24 09:54:39 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-dcf10d8f-7304-408e-a340-e7fe5be2746a tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-2fd1e80a-8f2d-4c78-9b9f-655171f64477" released by "_delete_snapshot" :: held 3.845s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-dcf10d8f-7304-408e-a340-e7fe5be2746a tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-5a76e01d-46ba-459f-a700-dff5e30d13a3" released by "delete_snapshot" :: held 3.879s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:39 devstack cinder-volume[93447]: WARNING cinder.quota [None req-dcf10d8f-7304-408e-a340-e7fe5be2746a tempest-GroupSnapshotsTest-344279173 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-7860698 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-7860698, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:54:39 devstack cinder-volume[93447]: WARNING cinder.quota [None req-dcf10d8f-7304-408e-a340-e7fe5be2746a tempest-GroupSnapshotsTest-344279173 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-7860698 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-7860698, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:54:39 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-dcf10d8f-7304-408e-a340-e7fe5be2746a tempest-GroupSnapshotsTest-344279173 None] Created reservations ['46ad5e68-9a32-4237-905d-2817637d58f7', '41defd69-5f09-419c-b3a1-b3549aa8c538', 'fcb28696-3b7a-41fc-a2de-23e49d69c2f5', '29a32ee3-9cf9-4b41-a4d0-9ffacecbc748'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:54:39 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-dcf10d8f-7304-408e-a340-e7fe5be2746a tempest-GroupSnapshotsTest-344279173 None] group_snapshot 59bbaa38-0cdb-4614-8488-b3e12c290964: deleted successfully Jun 24 09:54:39 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3a5388e0-599f-492d-b8ba-98bec6ea087d tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ca99e9a-ad8e-4180-a86b-75af8d01f37b" returned: 0 in 0.788s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3a5388e0-599f-492d-b8ba-98bec6ea087d tempest-VolumesGetTest-696686733 None] Lock "cinder-quobyte-8ca99e9a-ad8e-4180-a86b-75af8d01f37b" released by "delete_volume" :: held 1.726s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:39 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-3a5388e0-599f-492d-b8ba-98bec6ea087d tempest-VolumesGetTest-696686733 None] Created reservations ['f24b1e0f-a87c-4bb6-b905-5e59082cb401', '81b20d2b-fb4b-481e-8800-12758b4d66a3', 'd0d43024-f08f-49e8-ab70-1648133e6cd8', '5b434596-2a5f-414d-a3eb-723aae8cb337'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:54:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3a5388e0-599f-492d-b8ba-98bec6ea087d tempest-VolumesGetTest-696686733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3a5388e0-599f-492d-b8ba-98bec6ea087d tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3a5388e0-599f-492d-b8ba-98bec6ea087d tempest-VolumesGetTest-696686733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:54:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3a5388e0-599f-492d-b8ba-98bec6ea087d tempest-VolumesGetTest-696686733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:54:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3a5388e0-599f-492d-b8ba-98bec6ea087d tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3a5388e0-599f-492d-b8ba-98bec6ea087d tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ef1a1174-296b-4678-a000-70cc9d4d988a tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "cinder-quobyte-5a76e01d-46ba-459f-a700-dff5e30d13a3" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:40 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:54:40 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ef1a1174-296b-4678-a000-70cc9d4d988a tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-5a76e01d-46ba-459f-a700-dff5e30d13a3" acquired by "delete_volume" :: waited 0.029s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:40 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c82df7-a74a-42ab-bf15-628aa7a665d0]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ef1a1174-296b-4678-a000-70cc9d4d988a tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:40 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3 Jun 24 09:54:40 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-96e56724-1182-412d-a1f5-25888e171696 tempest-VolumesGetTest-696686733 None] Acquiring lock "cinder-3087c6af-9bec-4f22-bf86-e0539a87150e-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-96e56724-1182-412d-a1f5-25888e171696 tempest-VolumesGetTest-696686733 None] Lock "cinder-3087c6af-9bec-4f22-bf86-e0539a87150e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-96e56724-1182-412d-a1f5-25888e171696 tempest-VolumesGetTest-696686733 None] Acquiring lock "cinder-quobyte-3087c6af-9bec-4f22-bf86-e0539a87150e" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-96e56724-1182-412d-a1f5-25888e171696 tempest-VolumesGetTest-696686733 None] Lock "cinder-quobyte-3087c6af-9bec-4f22-bf86-e0539a87150e" acquired by "delete_volume" :: waited 0.034s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:40 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e505874-bc84-494d-acfa-a8b2bb66d2a5]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-96e56724-1182-412d-a1f5-25888e171696 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3087c6af-9bec-4f22-bf86-e0539a87150e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:40 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3087c6af-9bec-4f22-bf86-e0539a87150e Jun 24 09:54:40 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:41 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3a5388e0-599f-492d-b8ba-98bec6ea087d tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.121s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:41 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-3a5388e0-599f-492d-b8ba-98bec6ea087d tempest-VolumesGetTest-696686733 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:54:41 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-3a5388e0-599f-492d-b8ba-98bec6ea087d tempest-VolumesGetTest-696686733 None] Deleted volume successfully. Jun 24 09:54:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3a5388e0-599f-492d-b8ba-98bec6ea087d tempest-VolumesGetTest-696686733 None] Lock "cinder-8ca99e9a-ad8e-4180-a86b-75af8d01f37b-delete_volume" released by "delete_volume" :: held 3.160s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:41 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ef1a1174-296b-4678-a000-70cc9d4d988a tempest-GroupSnapshotsTest-344279173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3" returned: 0 in 1.159s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ef1a1174-296b-4678-a000-70cc9d4d988a tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:41 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3 Jun 24 09:54:41 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:41 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-96e56724-1182-412d-a1f5-25888e171696 tempest-VolumesGetTest-696686733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3087c6af-9bec-4f22-bf86-e0539a87150e" returned: 0 in 0.931s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-96e56724-1182-412d-a1f5-25888e171696 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3087c6af-9bec-4f22-bf86-e0539a87150e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:41 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3087c6af-9bec-4f22-bf86-e0539a87150e Jun 24 09:54:41 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:42 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ef1a1174-296b-4678-a000-70cc9d4d988a tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a76e01d-46ba-459f-a700-dff5e30d13a3" returned: 0 in 1.032s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:42 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ef1a1174-296b-4678-a000-70cc9d4d988a tempest-GroupSnapshotsTest-344279173 None] Lock "cinder-quobyte-5a76e01d-46ba-459f-a700-dff5e30d13a3" released by "delete_volume" :: held 2.322s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:42 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-ef1a1174-296b-4678-a000-70cc9d4d988a tempest-GroupSnapshotsTest-344279173 None] Created reservations ['d59b511a-05b2-4457-9df4-c163fd86cee3'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:54:42 devstack cinder-volume[93447]: WARNING cinder.quota [None req-ef1a1174-296b-4678-a000-70cc9d4d988a tempest-GroupSnapshotsTest-344279173 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-7860698 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-7860698, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:54:42 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-ef1a1174-296b-4678-a000-70cc9d4d988a tempest-GroupSnapshotsTest-344279173 None] Created reservations ['187d6075-de3f-447d-9268-83efcdc388d5', 'dd7d9551-0314-45c3-8fd5-c3bc1d2ce3d2', '9b95c4f7-b9c2-48e3-9194-c524b668e034', '3f8cbf12-63be-41c4-8738-1a38fed90e37'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:54:42 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-003deace-698b-4732-bb11-306ea2e816e9 req-714342d0-58c3-4db7-b6b3-0295b002610f tempest-AttachVolumeTestJSON-524336646 None] Terminate volume connection completed successfully. Jun 24 09:54:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-003deace-698b-4732-bb11-306ea2e816e9 req-714342d0-58c3-4db7-b6b3-0295b002610f tempest-AttachVolumeTestJSON-524336646 None] Deleting attachment c6ff9906-a704-4dd4-b33f-d4e6619da702. {{(pid=93447) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 09:54:42 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-96e56724-1182-412d-a1f5-25888e171696 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3087c6af-9bec-4f22-bf86-e0539a87150e" returned: 0 in 1.079s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:42 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-96e56724-1182-412d-a1f5-25888e171696 tempest-VolumesGetTest-696686733 None] Lock "cinder-quobyte-3087c6af-9bec-4f22-bf86-e0539a87150e" released by "delete_volume" :: held 2.076s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:42 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-96e56724-1182-412d-a1f5-25888e171696 tempest-VolumesGetTest-696686733 None] Created reservations ['be006f96-7b36-4569-9a82-c547e2891de4', 'ccefc058-8f41-4d7d-8753-e8dcb0580bb7', '37fbbb61-a162-479e-b0c7-3df03526ff4e', 'b3266c37-282f-4558-8415-42bcf3c86d18'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:54:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ef1a1174-296b-4678-a000-70cc9d4d988a tempest-GroupSnapshotsTest-344279173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ef1a1174-296b-4678-a000-70cc9d4d988a tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ef1a1174-296b-4678-a000-70cc9d4d988a tempest-GroupSnapshotsTest-344279173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:54:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ef1a1174-296b-4678-a000-70cc9d4d988a tempest-GroupSnapshotsTest-344279173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:54:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ef1a1174-296b-4678-a000-70cc9d4d988a tempest-GroupSnapshotsTest-344279173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ef1a1174-296b-4678-a000-70cc9d4d988a tempest-GroupSnapshotsTest-344279173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:42 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:54:42 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-96e56724-1182-412d-a1f5-25888e171696 tempest-VolumesGetTest-696686733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-96e56724-1182-412d-a1f5-25888e171696 tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-96e56724-1182-412d-a1f5-25888e171696 tempest-VolumesGetTest-696686733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:54:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-96e56724-1182-412d-a1f5-25888e171696 tempest-VolumesGetTest-696686733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:54:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-96e56724-1182-412d-a1f5-25888e171696 tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-96e56724-1182-412d-a1f5-25888e171696 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:42 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:54:42 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:43 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ef1a1174-296b-4678-a000-70cc9d4d988a tempest-GroupSnapshotsTest-344279173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.660s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:43 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-ef1a1174-296b-4678-a000-70cc9d4d988a tempest-GroupSnapshotsTest-344279173 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:54:43 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-ef1a1174-296b-4678-a000-70cc9d4d988a tempest-GroupSnapshotsTest-344279173 None] Delete group completed successfully. Jun 24 09:54:43 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-96e56724-1182-412d-a1f5-25888e171696 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.722s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:43 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-96e56724-1182-412d-a1f5-25888e171696 tempest-VolumesGetTest-696686733 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:54:43 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-96e56724-1182-412d-a1f5-25888e171696 tempest-VolumesGetTest-696686733 None] Deleted volume successfully. Jun 24 09:54:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-96e56724-1182-412d-a1f5-25888e171696 tempest-VolumesGetTest-696686733 None] Lock "cinder-3087c6af-9bec-4f22-bf86-e0539a87150e-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:54:44 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:54:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Flow 'volume_create_manager' (99871eb6-2bed-4407-bc19-52b9c403af62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:54:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67a9a55-5c1b-4c1c-91fd-279e9907467f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67a9a55-5c1b-4c1c-91fd-279e9907467f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1846362918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1583379b-a351-4b9d-a354-439520595044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf94bf08bf443c0a23eaf5ac03f0314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:54:45Z,use_quota=True,user_id='1808a15ca11b48ba8257f8fe9f81df6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a42823c-13ca-4055-80fb-a3855ea59646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a42823c-13ca-4055-80fb-a3855ea59646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb8f0a71-a291-4fc6-9ab2-6bdbcc4883e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb8f0a71-a291-4fc6-9ab2-6bdbcc4883e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1583379b-a351-4b9d-a354-439520595044', 'volume_name': 'volume-1583379b-a351-4b9d-a354-439520595044', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d4e0ba-0bbd-4894-9e2e-2b4001b28ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d4e0ba-0bbd-4894-9e2e-2b4001b28ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db76693b-8744-4095-b18f-74b483681724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:44 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Volume 1583379b-a351-4b9d-a354-439520595044: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1583379b-a351-4b9d-a354-439520595044', 'volume_size': 1} Jun 24 09:54:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1846362918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1583379b-a351-4b9d-a354-439520595044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf94bf08bf443c0a23eaf5ac03f0314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:54:45Z,use_quota=True,user_id='1808a15ca11b48ba8257f8fe9f81df6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:54:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Creating volume 1583379b-a351-4b9d-a354-439520595044 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:54:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:54:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:54:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:54:44 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:54:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:44 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044 1073741824 Jun 24 09:54:44 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:45 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044 1073741824" returned: 0 in 1.128s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:45 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044 Jun 24 09:54:45 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:46 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-2ee65238-0f93-4484-bfac-65cbc715c464 req-75de7c73-f84e-4ab5-986e-7b9afadefc73 tempest-AttachVolumeTestJSON-524336646 None] Terminate volume connection completed successfully. Jun 24 09:54:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-2ee65238-0f93-4484-bfac-65cbc715c464 req-75de7c73-f84e-4ab5-986e-7b9afadefc73 tempest-AttachVolumeTestJSON-524336646 None] Deleting attachment 7586fcc1-7c11-4813-91c2-1be2659f73ef. {{(pid=93447) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 09:54:46 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044" returned: 0 in 0.843s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] <== create_volume: return (2050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:54:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db76693b-8744-4095-b18f-74b483681724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1583379b-a351-4b9d-a354-439520595044', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c061dac6-df58-4252-9257-c876d752c84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:46 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Volume volume-1583379b-a351-4b9d-a354-439520595044 (1583379b-a351-4b9d-a354-439520595044): created successfully Jun 24 09:54:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c061dac6-df58-4252-9257-c876d752c84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Flow 'volume_create_manager' (99871eb6-2bed-4407-bc19-52b9c403af62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:54:46 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-55564b0c-82d1-4b1d-8b8c-b5e15dc5d7b7 tempest-VolumesGetTest-696686733 None] Created volume successfully. Jun 24 09:54:48 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:54:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Flow 'volume_create_manager' (6eb01cac-cdf6-4ab0-a888-2c24dee0faa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:54:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5c94be-9ad6-4f9f-b475-50015125c1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac5c94be-9ad6-4f9f-b475-50015125c1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-537394279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e4cf6b7-87a4-4cfb-8984-007adf5b2253,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1cf94bf08bf443c0a23eaf5ac03f0314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=1583379b-a351-4b9d-a354-439520595044,status='creating',terminated_at=None,updated_at=2026-06-24T07:54:48Z,use_quota=True,user_id='1808a15ca11b48ba8257f8fe9f81df6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2371c7ad-3838-47de-8d9c-3a7ae0f7e1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2371c7ad-3838-47de-8d9c-3a7ae0f7e1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b45b1c03-007e-4b66-bf2e-bb2ba6189c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b45b1c03-007e-4b66-bf2e-bb2ba6189c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8e4cf6b7-87a4-4cfb-8984-007adf5b2253', 'volume_name': 'volume-8e4cf6b7-87a4-4cfb-8984-007adf5b2253', 'volume_size': 1, 'source_volid': '1583379b-a351-4b9d-a354-439520595044', 'source_volstatus': 'available'}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c74d578-4d35-4ef0-a73d-51db51c6725d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c74d578-4d35-4ef0-a73d-51db51c6725d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:54:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93dfa254-1637-491a-975b-71f256636bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:54:48 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Volume 8e4cf6b7-87a4-4cfb-8984-007adf5b2253: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8e4cf6b7-87a4-4cfb-8984-007adf5b2253', 'volume_size': 1, 'source_volid': '1583379b-a351-4b9d-a354-439520595044', 'source_volstatus': 'available'} Jun 24 09:54:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:48 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Cloning volume 1583379b-a351-4b9d-a354-439520595044 to volume 8e4cf6b7-87a4-4cfb-8984-007adf5b2253 Jun 24 09:54:48 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Creating offline snapshot 1bf59a1e-a9ee-4804-91c7-d99451246e04 of volume 1583379b-a351-4b9d-a354-439520595044 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 09:54:48 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccd5726-d6e2-41a7-a469-57889a5eed07]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:48 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044 Jun 24 09:54:48 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:49 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044" returned: 0 in 0.933s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.1bf59a1e-a9ee-4804-91c7-d99451246e04 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:49 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.1bf59a1e-a9ee-4804-91c7-d99451246e04 1G Jun 24 09:54:49 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:51 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.1bf59a1e-a9ee-4804-91c7-d99451246e04 1G" returned: 0 in 1.389s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1583379b-a351-4b9d-a354-439520595044 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.1bf59a1e-a9ee-4804-91c7-d99451246e04 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:51 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1583379b-a351-4b9d-a354-439520595044 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.1bf59a1e-a9ee-4804-91c7-d99451246e04 Jun 24 09:54:51 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:52 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1583379b-a351-4b9d-a354-439520595044 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.1bf59a1e-a9ee-4804-91c7-d99451246e04" returned: 0 in 1.106s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:52 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.1bf59a1e-a9ee-4804-91c7-d99451246e04 is being set with open permissions: ugo+rw Jun 24 09:54:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.1bf59a1e-a9ee-4804-91c7-d99451246e04 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:52 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.1bf59a1e-a9ee-4804-91c7-d99451246e04 Jun 24 09:54:52 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:53 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.1bf59a1e-a9ee-4804-91c7-d99451246e04" returned: 0 in 0.899s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:53 devstack sudo[104224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.info Jun 24 09:54:53 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:53 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.info" returned: 0 in 0.807s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:53 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.info is being set with open permissions: ugo+rw Jun 24 09:54:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:54 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.info Jun 24 09:54:54 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:54 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.info" returned: 0 in 0.958s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:54 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Acquiring lock "cinder-quobyte-8e4cf6b7-87a4-4cfb-8984-007adf5b2253" by "_copy_volume_from_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:54:55 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Lock "cinder-quobyte-8e4cf6b7-87a4-4cfb-8984-007adf5b2253" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:54:55 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] snapshot: 1bf59a1e-a9ee-4804-91c7-d99451246e04, volume: 8e4cf6b7-87a4-4cfb-8984-007adf5b2253, {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 09:54:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:54:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:54:55 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:54:55 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:54:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:54:55 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1689c40-c892-4068-9c6d-df6a68d4c215]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.1bf59a1e-a9ee-4804-91c7-d99451246e04 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:55 devstack sudo[104232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.1bf59a1e-a9ee-4804-91c7-d99451246e04 Jun 24 09:54:55 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:55 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.1bf59a1e-a9ee-4804-91c7-d99451246e04" returned: 0 in 0.898s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:55 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1583379b-a351-4b9d-a354-439520595044(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:54:55 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044 {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 09:54:55 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Creating direct copy from snapshot {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 09:54:55 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[01970188-a83f-4765-91b6-d501d515dddd]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:54:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:56 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044 Jun 24 09:54:56 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:54:57 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Jun 24 09:54:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044" returned: 0 in 1.037s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:54:57 devstack cinder-volume[93447]: DEBUG cinder.utils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Path /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8e4cf6b7-87a4-4cfb-8984-007adf5b2253 not found in is_blk_device check {{(pid=93447) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 09:54:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8e4cf6b7-87a4-4cfb-8984-007adf5b2253 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:54:57 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8e4cf6b7-87a4-4cfb-8984-007adf5b2253 Jun 24 09:54:57 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:01 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-74d272b4-df3f-490f-a5ed-726909060dfe tempest-AttachVolumeTestJSON-524336646 None] Acquiring lock "cinder-94acd701-0309-42e3-9aad-2dbdc33e9892-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:01 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-74d272b4-df3f-490f-a5ed-726909060dfe tempest-AttachVolumeTestJSON-524336646 None] Lock "cinder-94acd701-0309-42e3-9aad-2dbdc33e9892-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:01 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=144,cinder:UPDATE=169,cinder:INSERT=32,cinder:DELETE=8 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:55:01 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:UPDATE=164,cinder:INSERT=47,cinder:DELETE=13,cinder:SELECT=133 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:55:01 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-74d272b4-df3f-490f-a5ed-726909060dfe tempest-AttachVolumeTestJSON-524336646 None] Acquiring lock "cinder-quobyte-94acd701-0309-42e3-9aad-2dbdc33e9892" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:01 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-74d272b4-df3f-490f-a5ed-726909060dfe tempest-AttachVolumeTestJSON-524336646 None] Lock "cinder-quobyte-94acd701-0309-42e3-9aad-2dbdc33e9892" acquired by "delete_volume" :: waited 0.050s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:01 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44a07af-043d-4743-9073-1c9221070a46]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-74d272b4-df3f-490f-a5ed-726909060dfe tempest-AttachVolumeTestJSON-524336646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-94acd701-0309-42e3-9aad-2dbdc33e9892 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:02 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-94acd701-0309-42e3-9aad-2dbdc33e9892 Jun 24 09:55:02 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:03 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-74d272b4-df3f-490f-a5ed-726909060dfe tempest-AttachVolumeTestJSON-524336646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-94acd701-0309-42e3-9aad-2dbdc33e9892" returned: 0 in 2.212s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-74d272b4-df3f-490f-a5ed-726909060dfe tempest-AttachVolumeTestJSON-524336646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-94acd701-0309-42e3-9aad-2dbdc33e9892 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:04 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-94acd701-0309-42e3-9aad-2dbdc33e9892 Jun 24 09:55:04 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:04 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8e4cf6b7-87a4-4cfb-8984-007adf5b2253" returned: 0 in 7.218s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:04 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7545233-c01f-40d2-a73d-a0f2b7022afc]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:04 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044 Jun 24 09:55:04 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:05 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-74d272b4-df3f-490f-a5ed-726909060dfe tempest-AttachVolumeTestJSON-524336646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-94acd701-0309-42e3-9aad-2dbdc33e9892" returned: 0 in 1.119s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-74d272b4-df3f-490f-a5ed-726909060dfe tempest-AttachVolumeTestJSON-524336646 None] Lock "cinder-quobyte-94acd701-0309-42e3-9aad-2dbdc33e9892" released by "delete_volume" :: held 3.465s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:05 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-74d272b4-df3f-490f-a5ed-726909060dfe tempest-AttachVolumeTestJSON-524336646 None] Created reservations ['3ccb4659-36b1-493e-bff0-986fc46d1ad9', '5ad9e3b9-a4f1-4867-bde5-b1efae807ad1', '2ee26e37-d370-422d-9a43-bd8d06f32695', 'e0366bc9-a9d4-4fdc-962e-890d4bd726a5'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:55:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-74d272b4-df3f-490f-a5ed-726909060dfe tempest-AttachVolumeTestJSON-524336646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-74d272b4-df3f-490f-a5ed-726909060dfe tempest-AttachVolumeTestJSON-524336646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:05 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-74d272b4-df3f-490f-a5ed-726909060dfe tempest-AttachVolumeTestJSON-524336646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:05 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-74d272b4-df3f-490f-a5ed-726909060dfe tempest-AttachVolumeTestJSON-524336646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-74d272b4-df3f-490f-a5ed-726909060dfe tempest-AttachVolumeTestJSON-524336646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-74d272b4-df3f-490f-a5ed-726909060dfe tempest-AttachVolumeTestJSON-524336646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:05 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:55:05 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:05 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044" returned: 0 in 1.386s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:05 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044, size 1024.00 MB, duration 7.23 sec, destination /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8e4cf6b7-87a4-4cfb-8984-007adf5b2253 {{(pid=93447) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 09:55:05 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Converted 1024.00 MB image at 141.73 MB/s Jun 24 09:55:05 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8e4cf6b7-87a4-4cfb-8984-007adf5b2253 is being set with open permissions: ugo+rw Jun 24 09:55:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8e4cf6b7-87a4-4cfb-8984-007adf5b2253 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:05 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8e4cf6b7-87a4-4cfb-8984-007adf5b2253 Jun 24 09:55:05 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:06 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-74d272b4-df3f-490f-a5ed-726909060dfe tempest-AttachVolumeTestJSON-524336646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.761s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-74d272b4-df3f-490f-a5ed-726909060dfe tempest-AttachVolumeTestJSON-524336646 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:55:06 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-74d272b4-df3f-490f-a5ed-726909060dfe tempest-AttachVolumeTestJSON-524336646 None] Deleted volume successfully. Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-74d272b4-df3f-490f-a5ed-726909060dfe tempest-AttachVolumeTestJSON-524336646 None] Lock "cinder-94acd701-0309-42e3-9aad-2dbdc33e9892-delete_volume" released by "delete_volume" :: held 4.714s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f2533819-71b0-4e15-b2ac-6cbb8b7cecb4 tempest-AttachVolumeTestJSON-524336646 None] Acquiring lock "cinder-ea595ac1-f85c-4e85-a208-c125b1f1d309-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f2533819-71b0-4e15-b2ac-6cbb8b7cecb4 tempest-AttachVolumeTestJSON-524336646 None] Lock "cinder-ea595ac1-f85c-4e85-a208-c125b1f1d309-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f2533819-71b0-4e15-b2ac-6cbb8b7cecb4 tempest-AttachVolumeTestJSON-524336646 None] Acquiring lock "cinder-quobyte-ea595ac1-f85c-4e85-a208-c125b1f1d309" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f2533819-71b0-4e15-b2ac-6cbb8b7cecb4 tempest-AttachVolumeTestJSON-524336646 None] Lock "cinder-quobyte-ea595ac1-f85c-4e85-a208-c125b1f1d309" acquired by "delete_volume" :: waited 0.025s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d01228-cee9-4cf7-9b7a-07922bec9c8e]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f2533819-71b0-4e15-b2ac-6cbb8b7cecb4 tempest-AttachVolumeTestJSON-524336646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea595ac1-f85c-4e85-a208-c125b1f1d309 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:06 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8e4cf6b7-87a4-4cfb-8984-007adf5b2253" returned: 0 in 0.939s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Lock "cinder-quobyte-8e4cf6b7-87a4-4cfb-8984-007adf5b2253" released by "_copy_volume_from_snapshot" :: held 11.610s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Acquiring lock "cinder-quobyte-1bf59a1e-a9ee-4804-91c7-d99451246e04" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Lock "cinder-quobyte-1bf59a1e-a9ee-4804-91c7-d99451246e04" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Deleting offline snapshot 1bf59a1e-a9ee-4804-91c7-d99451246e04 of volume 1583379b-a351-4b9d-a354-439520595044 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] snapshot_file for this snap is: volume-1583379b-a351-4b9d-a354-439520595044.1bf59a1e-a9ee-4804-91c7-d99451246e04 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bb9f6d-b51a-4fea-b2f7-7fc01d029cbe]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.1bf59a1e-a9ee-4804-91c7-d99451246e04 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:06 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea595ac1-f85c-4e85-a208-c125b1f1d309 Jun 24 09:55:06 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Flow 'volume_create_manager' (803bde4d-2d03-4f79-ab69-3368d1b11101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58454a0b-fe06-4a72-a9f1-bf5582c124c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58454a0b-fe06-4a72-a9f1-bf5582c124c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1683305163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce56f3e6-1d9a-46ce-8b59-41dd01a5e706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96436022ac2e4f8d9a895396a43142b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:55:07Z,use_quota=True,user_id='224c39b72655486baf45a2e71095ddb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0534837-e0a2-4d6a-93da-d26f5b514ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0534837-e0a2-4d6a-93da-d26f5b514ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4fd90d-3d19-424f-90b8-519c48d4cb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:06 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4fd90d-3d19-424f-90b8-519c48d4cb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce56f3e6-1d9a-46ce-8b59-41dd01a5e706', 'volume_name': 'volume-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:06 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.1bf59a1e-a9ee-4804-91c7-d99451246e04 Jun 24 09:55:07 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fee1bf-e748-4352-8247-0caac90e71a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fee1bf-e748-4352-8247-0caac90e71a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d260edfc-aea5-4bf4-9ca9-de411d9fefc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:07 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Volume ce56f3e6-1d9a-46ce-8b59-41dd01a5e706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706', 'volume_size': 1} Jun 24 09:55:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:07 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:55:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Flow 'volume_create_manager' (e7d5006c-1c3c-437e-ad8d-4380fe58bec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:55:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca30a4c7-1b10-4993-9354-d34c0a51002d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca30a4c7-1b10-4993-9354-d34c0a51002d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-734470522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882f8953-8c44-4103-a1c3-015b7bca1cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96436022ac2e4f8d9a895396a43142b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:55:07Z,use_quota=True,user_id='224c39b72655486baf45a2e71095ddb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24cd7f9e-61c5-42b0-9737-a54117951389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24cd7f9e-61c5-42b0-9737-a54117951389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79869355-3b7e-4238-af4b-9ffc647b2ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79869355-3b7e-4238-af4b-9ffc647b2ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '882f8953-8c44-4103-a1c3-015b7bca1cc1', 'volume_name': 'volume-882f8953-8c44-4103-a1c3-015b7bca1cc1', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9077ee88-9c20-49ba-98a4-506452281389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9077ee88-9c20-49ba-98a4-506452281389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ac6bfb-efb3-40b3-bbab-df469d6d79d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:07 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Volume 882f8953-8c44-4103-a1c3-015b7bca1cc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-882f8953-8c44-4103-a1c3-015b7bca1cc1', 'volume_size': 1} Jun 24 09:55:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:07 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f2533819-71b0-4e15-b2ac-6cbb8b7cecb4 tempest-AttachVolumeTestJSON-524336646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea595ac1-f85c-4e85-a208-c125b1f1d309" returned: 0 in 0.971s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f2533819-71b0-4e15-b2ac-6cbb8b7cecb4 tempest-AttachVolumeTestJSON-524336646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea595ac1-f85c-4e85-a208-c125b1f1d309 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:07 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea595ac1-f85c-4e85-a208-c125b1f1d309 Jun 24 09:55:07 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:07 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.1bf59a1e-a9ee-4804-91c7-d99451246e04" returned: 0 in 1.112s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:07 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1583379b-a351-4b9d-a354-439520595044(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:55:07 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[156435ba-e109-4d2c-af2a-5fb9756d1aa3]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:08 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044 Jun 24 09:55:08 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:08 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f2533819-71b0-4e15-b2ac-6cbb8b7cecb4 tempest-AttachVolumeTestJSON-524336646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ea595ac1-f85c-4e85-a208-c125b1f1d309" returned: 0 in 0.814s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:08 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f2533819-71b0-4e15-b2ac-6cbb8b7cecb4 tempest-AttachVolumeTestJSON-524336646 None] Lock "cinder-quobyte-ea595ac1-f85c-4e85-a208-c125b1f1d309" released by "delete_volume" :: held 1.862s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:08 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-f2533819-71b0-4e15-b2ac-6cbb8b7cecb4 tempest-AttachVolumeTestJSON-524336646 None] Created reservations ['5635a7dd-5eeb-482a-8166-378b3b0b5d60', 'f5fcb24b-d621-4861-9ee1-8a4fda7ba815', '848d3a09-466f-46ba-8edc-3630cd728214', '976d1778-6f8a-46c2-90e2-cacae0f0618b'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:55:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f2533819-71b0-4e15-b2ac-6cbb8b7cecb4 tempest-AttachVolumeTestJSON-524336646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f2533819-71b0-4e15-b2ac-6cbb8b7cecb4 tempest-AttachVolumeTestJSON-524336646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f2533819-71b0-4e15-b2ac-6cbb8b7cecb4 tempest-AttachVolumeTestJSON-524336646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f2533819-71b0-4e15-b2ac-6cbb8b7cecb4 tempest-AttachVolumeTestJSON-524336646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f2533819-71b0-4e15-b2ac-6cbb8b7cecb4 tempest-AttachVolumeTestJSON-524336646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f2533819-71b0-4e15-b2ac-6cbb8b7cecb4 tempest-AttachVolumeTestJSON-524336646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:08 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:55:08 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:08 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-94e2c01a-07ae-47f5-a495-acdbd07a039e tempest-AttachVolumeTestJSON-524336646 None] Acquiring lock "cinder-67ef48db-6ea4-494a-b476-18fd5422bcd2-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:08 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-94e2c01a-07ae-47f5-a495-acdbd07a039e tempest-AttachVolumeTestJSON-524336646 None] Lock "cinder-67ef48db-6ea4-494a-b476-18fd5422bcd2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:08 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044" returned: 0 in 1.087s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.1bf59a1e-a9ee-4804-91c7-d99451246e04 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:09 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-94e2c01a-07ae-47f5-a495-acdbd07a039e tempest-AttachVolumeTestJSON-524336646 None] Acquiring lock "cinder-quobyte-67ef48db-6ea4-494a-b476-18fd5422bcd2" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:09 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.1bf59a1e-a9ee-4804-91c7-d99451246e04 Jun 24 09:55:09 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:09 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-94e2c01a-07ae-47f5-a495-acdbd07a039e tempest-AttachVolumeTestJSON-524336646 None] Lock "cinder-quobyte-67ef48db-6ea4-494a-b476-18fd5422bcd2" acquired by "delete_volume" :: waited 0.024s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:09 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[26372cca-0d4f-4445-8240-d8e363e636f6]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-94e2c01a-07ae-47f5-a495-acdbd07a039e tempest-AttachVolumeTestJSON-524336646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-67ef48db-6ea4-494a-b476-18fd5422bcd2 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:09 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-67ef48db-6ea4-494a-b476-18fd5422bcd2 Jun 24 09:55:09 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:09 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f2533819-71b0-4e15-b2ac-6cbb8b7cecb4 tempest-AttachVolumeTestJSON-524336646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.922s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:09 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-f2533819-71b0-4e15-b2ac-6cbb8b7cecb4 tempest-AttachVolumeTestJSON-524336646 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:55:09 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-f2533819-71b0-4e15-b2ac-6cbb8b7cecb4 tempest-AttachVolumeTestJSON-524336646 None] Deleted volume successfully. Jun 24 09:55:09 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f2533819-71b0-4e15-b2ac-6cbb8b7cecb4 tempest-AttachVolumeTestJSON-524336646 None] Lock "cinder-ea595ac1-f85c-4e85-a208-c125b1f1d309-delete_volume" released by "delete_volume" :: held 3.082s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:09 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-f46fdb43-a47a-4899-b77d-fbba6d0d6092 tempest-GroupsTest-1614604146 None] Group tempest-Group1-798079890: creating Jun 24 09:55:09 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-f46fdb43-a47a-4899-b77d-fbba6d0d6092 tempest-GroupsTest-1614604146 None] Group tempest-Group1-798079890: created successfully Jun 24 09:55:09 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-f46fdb43-a47a-4899-b77d-fbba6d0d6092 tempest-GroupsTest-1614604146 None] Create group completed successfully. Jun 24 09:55:09 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.1bf59a1e-a9ee-4804-91c7-d99451246e04" returned: 0 in 0.970s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.1bf59a1e-a9ee-4804-91c7-d99451246e04 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:09 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.1bf59a1e-a9ee-4804-91c7-d99451246e04 Jun 24 09:55:09 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:10 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-94e2c01a-07ae-47f5-a495-acdbd07a039e tempest-AttachVolumeTestJSON-524336646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-67ef48db-6ea4-494a-b476-18fd5422bcd2" returned: 0 in 1.045s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-94e2c01a-07ae-47f5-a495-acdbd07a039e tempest-AttachVolumeTestJSON-524336646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-67ef48db-6ea4-494a-b476-18fd5422bcd2 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:10 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-67ef48db-6ea4-494a-b476-18fd5422bcd2 Jun 24 09:55:10 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:10 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044.1bf59a1e-a9ee-4804-91c7-d99451246e04" returned: 0 in 0.698s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:10 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Lock "cinder-quobyte-1bf59a1e-a9ee-4804-91c7-d99451246e04" released by "_delete_snapshot" :: held 4.018s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.048s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.749s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1683305163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce56f3e6-1d9a-46ce-8b59-41dd01a5e706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96436022ac2e4f8d9a895396a43142b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:55:07Z,use_quota=True,user_id='224c39b72655486baf45a2e71095ddb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:55:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Creating volume ce56f3e6-1d9a-46ce-8b59-41dd01a5e706 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:55:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:55:10 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:55:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:10 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706 1073741824 Jun 24 09:55:10 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93dfa254-1637-491a-975b-71f256636bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e4cf6b7-87a4-4cfb-8984-007adf5b2253', 'volume_size': 1, 'source_volid': '1583379b-a351-4b9d-a354-439520595044', 'source_volstatus': 'available'}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57223f0f-e55a-4513-a7f5-48423464b061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:10 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Volume volume-8e4cf6b7-87a4-4cfb-8984-007adf5b2253 (8e4cf6b7-87a4-4cfb-8984-007adf5b2253): created successfully Jun 24 09:55:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57223f0f-e55a-4513-a7f5-48423464b061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Flow 'volume_create_manager' (6eb01cac-cdf6-4ab0-a888-2c24dee0faa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:55:10 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-1acd974b-c34e-4374-8eae-c22847cfa360 tempest-VolumesGetTest-696686733 None] Created volume successfully. Jun 24 09:55:10 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-114e6d58-de60-454d-8427-b04952226efb tempest-GroupsTest-1614604146 None] Group tempest-Group2-1651806752: creating Jun 24 09:55:10 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-114e6d58-de60-454d-8427-b04952226efb tempest-GroupsTest-1614604146 None] Group tempest-Group2-1651806752: created successfully Jun 24 09:55:11 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-114e6d58-de60-454d-8427-b04952226efb tempest-GroupsTest-1614604146 None] Create group completed successfully. Jun 24 09:55:11 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-94e2c01a-07ae-47f5-a495-acdbd07a039e tempest-AttachVolumeTestJSON-524336646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-67ef48db-6ea4-494a-b476-18fd5422bcd2" returned: 0 in 0.908s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:11 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-94e2c01a-07ae-47f5-a495-acdbd07a039e tempest-AttachVolumeTestJSON-524336646 None] Lock "cinder-quobyte-67ef48db-6ea4-494a-b476-18fd5422bcd2" released by "delete_volume" :: held 2.008s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:11 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-94e2c01a-07ae-47f5-a495-acdbd07a039e tempest-AttachVolumeTestJSON-524336646 None] Created reservations ['cc54cec7-d19d-4b94-ad06-41285226f407', '0ff6e92b-3d5d-4c0c-a3a7-81ffcc59d2ac', '4eeae5ac-4fa9-4f5c-9559-8e0622b07b37', '9f8ad34e-3491-462d-896e-b4024c2f1c8b'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:55:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-94e2c01a-07ae-47f5-a495-acdbd07a039e tempest-AttachVolumeTestJSON-524336646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-94e2c01a-07ae-47f5-a495-acdbd07a039e tempest-AttachVolumeTestJSON-524336646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:11 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-94e2c01a-07ae-47f5-a495-acdbd07a039e tempest-AttachVolumeTestJSON-524336646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:11 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-94e2c01a-07ae-47f5-a495-acdbd07a039e tempest-AttachVolumeTestJSON-524336646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-94e2c01a-07ae-47f5-a495-acdbd07a039e tempest-AttachVolumeTestJSON-524336646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-94e2c01a-07ae-47f5-a495-acdbd07a039e tempest-AttachVolumeTestJSON-524336646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:11 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:55:11 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:12 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706 1073741824" returned: 0 in 1.462s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:12 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-94e2c01a-07ae-47f5-a495-acdbd07a039e tempest-AttachVolumeTestJSON-524336646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.972s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-94e2c01a-07ae-47f5-a495-acdbd07a039e tempest-AttachVolumeTestJSON-524336646 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:55:12 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-94e2c01a-07ae-47f5-a495-acdbd07a039e tempest-AttachVolumeTestJSON-524336646 None] Deleted volume successfully. Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Flow 'volume_create_manager' (b97f409f-a589-495f-806c-ccda9c64b2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c31840ae-fefb-4b5d-9b14-1d85d7da61bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c31840ae-fefb-4b5d-9b14-1d85d7da61bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:55:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1929862237',display_name='tempest-VolumesGetTest-Volume-810598763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456cbba0-c282-4d79-b097-88fcf9fb688a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf94bf08bf443c0a23eaf5ac03f0314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:55:12Z,use_quota=True,user_id='1808a15ca11b48ba8257f8fe9f81df6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a80789-62f8-4e31-a8d9-662b0252a922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a80789-62f8-4e31-a8d9-662b0252a922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbd89c4a-430b-40b1-80c0-b44df3d1f660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbd89c4a-430b-40b1-80c0-b44df3d1f660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '456cbba0-c282-4d79-b097-88fcf9fb688a', 'volume_name': 'volume-456cbba0-c282-4d79-b097-88fcf9fb688a', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37dbe43-b44a-43ea-ba66-1d644e9a12e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37dbe43-b44a-43ea-ba66-1d644e9a12e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (893f4686-c02e-4cf9-872d-3b57ae67ae1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:12 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Volume 456cbba0-c282-4d79-b097-88fcf9fb688a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-456cbba0-c282-4d79-b097-88fcf9fb688a', 'volume_size': 1} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-94e2c01a-07ae-47f5-a495-acdbd07a039e tempest-AttachVolumeTestJSON-524336646 None] Lock "cinder-67ef48db-6ea4-494a-b476-18fd5422bcd2-delete_volume" released by "delete_volume" :: held 3.547s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:12 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706 Jun 24 09:55:12 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Flow 'volume_create_manager' (18a208c6-31a0-474e-b22f-cebfd8275ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3c3b74-8fa7-4152-8cdc-ecc9e36fc742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3c3b74-8fa7-4152-8cdc-ecc9e36fc742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1566210398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fdc0f826-db16-44a1-9e02-14df319e6e79,host='devstack@QuobyteHD#QuobyteHD',id=44aba633-4a1c-46dd-a349-293a441e9394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6abfbade21a940a38075d89f33cf911a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:55:13Z,use_quota=True,user_id='e0b7609370764b39bd703b2c2b14c4e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b48fe7f5-01ae-4059-9614-488442e0e880),volume_type_id=b48fe7f5-01ae-4059-9614-488442e0e880)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f67a5cf-f311-4d86-9a91-6eebf64284be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f67a5cf-f311-4d86-9a91-6eebf64284be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe89d2c-4dfd-4011-9cff-798c1aca18cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe89d2c-4dfd-4011-9cff-798c1aca18cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44aba633-4a1c-46dd-a349-293a441e9394', 'volume_name': 'volume-44aba633-4a1c-46dd-a349-293a441e9394', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ccea00b-edcd-4755-afc1-7417b200b372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ccea00b-edcd-4755-afc1-7417b200b372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89e60f7-adb9-4c56-9930-fe9df0faa6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:12 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Volume 44aba633-4a1c-46dd-a349-293a441e9394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44aba633-4a1c-46dd-a349-293a441e9394', 'volume_size': 1} Jun 24 09:55:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:13 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706" returned: 0 in 0.786s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] <== create_volume: return (2476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:55:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.479s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.874s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-734470522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882f8953-8c44-4103-a1c3-015b7bca1cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96436022ac2e4f8d9a895396a43142b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:55:07Z,use_quota=True,user_id='224c39b72655486baf45a2e71095ddb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:55:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Creating volume 882f8953-8c44-4103-a1c3-015b7bca1cc1 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:55:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:55:13 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:55:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-882f8953-8c44-4103-a1c3-015b7bca1cc1 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d260edfc-aea5-4bf4-9ca9-de411d9fefc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:13 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-882f8953-8c44-4103-a1c3-015b7bca1cc1 1073741824 Jun 24 09:55:13 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f0f139-54cf-4542-9b4d-b09e2ed810c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:13 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Volume volume-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706 (ce56f3e6-1d9a-46ce-8b59-41dd01a5e706): created successfully Jun 24 09:55:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f0f139-54cf-4542-9b4d-b09e2ed810c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Flow 'volume_create_manager' (803bde4d-2d03-4f79-ab69-3368d1b11101) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:55:13 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-ecf29a68-da41-44c6-9d73-1e44b5d34270 tempest-TestServerVolumeAttachmentScenario-322011846 None] Created volume successfully. Jun 24 09:55:14 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-882f8953-8c44-4103-a1c3-015b7bca1cc1 1073741824" returned: 0 in 1.014s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-882f8953-8c44-4103-a1c3-015b7bca1cc1 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:14 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-882f8953-8c44-4103-a1c3-015b7bca1cc1 Jun 24 09:55:14 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:14 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-882f8953-8c44-4103-a1c3-015b7bca1cc1" returned: 0 in 0.664s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:14 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:55:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.520s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:14 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:55:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1929862237',display_name='tempest-VolumesGetTest-Volume-810598763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456cbba0-c282-4d79-b097-88fcf9fb688a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf94bf08bf443c0a23eaf5ac03f0314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:55:12Z,use_quota=True,user_id='1808a15ca11b48ba8257f8fe9f81df6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:55:14 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Creating volume 456cbba0-c282-4d79-b097-88fcf9fb688a {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:55:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:14 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:14 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:14 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:55:14 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:55:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-456cbba0-c282-4d79-b097-88fcf9fb688a 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:15 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-456cbba0-c282-4d79-b097-88fcf9fb688a 1073741824 Jun 24 09:55:15 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ac6bfb-efb3-40b3-bbab-df469d6d79d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-882f8953-8c44-4103-a1c3-015b7bca1cc1', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3a68d1-51e5-4bc3-827f-d333b30e72ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:15 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Volume volume-882f8953-8c44-4103-a1c3-015b7bca1cc1 (882f8953-8c44-4103-a1c3-015b7bca1cc1): created successfully Jun 24 09:55:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3a68d1-51e5-4bc3-827f-d333b30e72ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Flow 'volume_create_manager' (e7d5006c-1c3c-437e-ad8d-4380fe58bec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:55:15 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-9f6a8993-ba6e-4972-9cb0-fbe8a9ce5014 tempest-TestServerVolumeAttachmentScenario-322011846 None] Created volume successfully. Jun 24 09:55:16 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-456cbba0-c282-4d79-b097-88fcf9fb688a 1073741824" returned: 0 in 1.039s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-456cbba0-c282-4d79-b097-88fcf9fb688a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:16 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-456cbba0-c282-4d79-b097-88fcf9fb688a Jun 24 09:55:16 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:16 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-456cbba0-c282-4d79-b097-88fcf9fb688a" returned: 0 in 0.813s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:16 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:55:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.912s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.932s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:16 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fdc0f826-db16-44a1-9e02-14df319e6e79,created_at=2026-06-24T07:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1566210398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fdc0f826-db16-44a1-9e02-14df319e6e79,host='devstack@QuobyteHD#QuobyteHD',id=44aba633-4a1c-46dd-a349-293a441e9394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6abfbade21a940a38075d89f33cf911a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:55:13Z,use_quota=True,user_id='e0b7609370764b39bd703b2c2b14c4e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b48fe7f5-01ae-4059-9614-488442e0e880),volume_type_id=b48fe7f5-01ae-4059-9614-488442e0e880)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:55:16 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Creating volume 44aba633-4a1c-46dd-a349-293a441e9394 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:55:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:16 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:16 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:16 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:55:16 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:55:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-44aba633-4a1c-46dd-a349-293a441e9394 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:16 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-44aba633-4a1c-46dd-a349-293a441e9394 1073741824 Jun 24 09:55:16 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (893f4686-c02e-4cf9-872d-3b57ae67ae1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-456cbba0-c282-4d79-b097-88fcf9fb688a', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:16 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:16 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22d1338-191d-43e6-bd9f-2dc06c81e25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:16 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Volume volume-456cbba0-c282-4d79-b097-88fcf9fb688a (456cbba0-c282-4d79-b097-88fcf9fb688a): created successfully Jun 24 09:55:16 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22d1338-191d-43e6-bd9f-2dc06c81e25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:16 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Flow 'volume_create_manager' (b97f409f-a589-495f-806c-ccda9c64b2c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:55:16 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-f4787107-00c4-4707-b645-0d956e7c68af tempest-VolumesGetTest-696686733 None] Created volume successfully. Jun 24 09:55:17 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-43e71010-9af5-4c76-87ab-f224bfaadaab tempest-VolumesGetTest-696686733 None] Acquiring lock "cinder-456cbba0-c282-4d79-b097-88fcf9fb688a-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:17 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-43e71010-9af5-4c76-87ab-f224bfaadaab tempest-VolumesGetTest-696686733 None] Lock "cinder-456cbba0-c282-4d79-b097-88fcf9fb688a-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:18 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-43e71010-9af5-4c76-87ab-f224bfaadaab tempest-VolumesGetTest-696686733 None] Acquiring lock "cinder-quobyte-456cbba0-c282-4d79-b097-88fcf9fb688a" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:18 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-43e71010-9af5-4c76-87ab-f224bfaadaab tempest-VolumesGetTest-696686733 None] Lock "cinder-quobyte-456cbba0-c282-4d79-b097-88fcf9fb688a" acquired by "delete_volume" :: waited 0.047s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:18 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[500b9a44-5f12-4ae3-a944-c2d26b4f9ce2]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-43e71010-9af5-4c76-87ab-f224bfaadaab tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-456cbba0-c282-4d79-b097-88fcf9fb688a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:18 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-44aba633-4a1c-46dd-a349-293a441e9394 1073741824" returned: 0 in 1.280s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-44aba633-4a1c-46dd-a349-293a441e9394 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:18 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-44aba633-4a1c-46dd-a349-293a441e9394 Jun 24 09:55:18 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:18 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-456cbba0-c282-4d79-b097-88fcf9fb688a Jun 24 09:55:18 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:19 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-44aba633-4a1c-46dd-a349-293a441e9394" returned: 0 in 0.912s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:19 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] <== create_volume: return (2257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:55:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.262s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89e60f7-adb9-4c56-9930-fe9df0faa6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44aba633-4a1c-46dd-a349-293a441e9394', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b191ef-408d-4d35-ba45-e8f8a7d08fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:19 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-43e71010-9af5-4c76-87ab-f224bfaadaab tempest-VolumesGetTest-696686733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-456cbba0-c282-4d79-b097-88fcf9fb688a" returned: 0 in 1.123s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-43e71010-9af5-4c76-87ab-f224bfaadaab tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-456cbba0-c282-4d79-b097-88fcf9fb688a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:19 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Volume volume-44aba633-4a1c-46dd-a349-293a441e9394 (44aba633-4a1c-46dd-a349-293a441e9394): created successfully Jun 24 09:55:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b191ef-408d-4d35-ba45-e8f8a7d08fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Flow 'volume_create_manager' (18a208c6-31a0-474e-b22f-cebfd8275ae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:55:19 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-456cbba0-c282-4d79-b097-88fcf9fb688a Jun 24 09:55:19 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:19 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-f7896a01-33bf-4f78-bea7-801de54b3a68 tempest-GroupsTest-1614604146 None] Created volume successfully. Jun 24 09:55:19 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-43e71010-9af5-4c76-87ab-f224bfaadaab tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-456cbba0-c282-4d79-b097-88fcf9fb688a" returned: 0 in 0.753s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:19 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-43e71010-9af5-4c76-87ab-f224bfaadaab tempest-VolumesGetTest-696686733 None] Lock "cinder-quobyte-456cbba0-c282-4d79-b097-88fcf9fb688a" released by "delete_volume" :: held 1.943s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:20 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-43e71010-9af5-4c76-87ab-f224bfaadaab tempest-VolumesGetTest-696686733 None] Created reservations ['da27671a-8fd1-429b-8637-40d477ba3a38', '81f0ebbc-b178-4ba0-a294-a52a6500adab', 'ee177ce7-a2bc-4270-b131-21a51ea5d88b', '82511fa4-dab1-4808-af7e-a12724da90c7'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:55:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-43e71010-9af5-4c76-87ab-f224bfaadaab tempest-VolumesGetTest-696686733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-43e71010-9af5-4c76-87ab-f224bfaadaab tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:20 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-43e71010-9af5-4c76-87ab-f224bfaadaab tempest-VolumesGetTest-696686733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:20 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-43e71010-9af5-4c76-87ab-f224bfaadaab tempest-VolumesGetTest-696686733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-43e71010-9af5-4c76-87ab-f224bfaadaab tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-43e71010-9af5-4c76-87ab-f224bfaadaab tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:20 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:55:20 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:20 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-09c95587-05e5-47a3-9898-c860375173a9 tempest-VolumesGetTest-696686733 None] Acquiring lock "cinder-8e4cf6b7-87a4-4cfb-8984-007adf5b2253-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:20 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-09c95587-05e5-47a3-9898-c860375173a9 tempest-VolumesGetTest-696686733 None] Lock "cinder-8e4cf6b7-87a4-4cfb-8984-007adf5b2253-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:20 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-09c95587-05e5-47a3-9898-c860375173a9 tempest-VolumesGetTest-696686733 None] Acquiring lock "cinder-quobyte-8e4cf6b7-87a4-4cfb-8984-007adf5b2253" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:20 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-09c95587-05e5-47a3-9898-c860375173a9 tempest-VolumesGetTest-696686733 None] Lock "cinder-quobyte-8e4cf6b7-87a4-4cfb-8984-007adf5b2253" acquired by "delete_volume" :: waited 0.048s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:20 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[653713e0-41c2-4fed-9694-1b2f29139b51]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-09c95587-05e5-47a3-9898-c860375173a9 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8e4cf6b7-87a4-4cfb-8984-007adf5b2253 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:20 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8e4cf6b7-87a4-4cfb-8984-007adf5b2253 Jun 24 09:55:20 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:21 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-43e71010-9af5-4c76-87ab-f224bfaadaab tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.429s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-43e71010-9af5-4c76-87ab-f224bfaadaab tempest-VolumesGetTest-696686733 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:55:21 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-43e71010-9af5-4c76-87ab-f224bfaadaab tempest-VolumesGetTest-696686733 None] Deleted volume successfully. Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Flow 'volume_create_manager' (5b86669d-513c-4f54-bea6-147b61531ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55324d45-169f-46d2-904a-54e4283989e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55324d45-169f-46d2-904a-54e4283989e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-265206263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8e02d2-49b5-4fde-8201-f198f7605286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed76aa3c74704d318c7d06f38bf93fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:55:21Z,use_quota=True,user_id='e7c86f4297ea4f4ca4909d14b23806d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a49774-a153-4630-a415-6ec9a1a2e13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a49774-a153-4630-a415-6ec9a1a2e13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39bb31a-f6ba-415d-8a64-80d84511ce5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39bb31a-f6ba-415d-8a64-80d84511ce5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a8e02d2-49b5-4fde-8201-f198f7605286', 'volume_name': 'volume-2a8e02d2-49b5-4fde-8201-f198f7605286', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f6aa50-1a66-44e8-a1a7-889b6117573f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f6aa50-1a66-44e8-a1a7-889b6117573f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656af438-dab2-4c75-9866-34eb5c80f8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:21 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Volume 2a8e02d2-49b5-4fde-8201-f198f7605286: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a8e02d2-49b5-4fde-8201-f198f7605286', 'volume_size': 1} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-265206263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8e02d2-49b5-4fde-8201-f198f7605286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed76aa3c74704d318c7d06f38bf93fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:55:21Z,use_quota=True,user_id='e7c86f4297ea4f4ca4909d14b23806d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Creating volume 2a8e02d2-49b5-4fde-8201-f198f7605286 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:55:21 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-43e71010-9af5-4c76-87ab-f224bfaadaab tempest-VolumesGetTest-696686733 None] Lock "cinder-456cbba0-c282-4d79-b097-88fcf9fb688a-delete_volume" released by "delete_volume" :: held 3.819s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:21 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286 1073741824 Jun 24 09:55:21 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b193f062-407d-407f-8057-63123c8d99e5 tempest-GroupsTest-1614604146 None] Acquiring lock "cinder-quobyte-44aba633-4a1c-46dd-a349-293a441e9394" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b193f062-407d-407f-8057-63123c8d99e5 tempest-GroupsTest-1614604146 None] Lock "cinder-quobyte-44aba633-4a1c-46dd-a349-293a441e9394" acquired by "delete_volume" :: waited 0.029s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5e8a2a-9f2b-4aaf-a791-8ac792d174ca]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b193f062-407d-407f-8057-63123c8d99e5 tempest-GroupsTest-1614604146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-44aba633-4a1c-46dd-a349-293a441e9394 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:21 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-44aba633-4a1c-46dd-a349-293a441e9394 Jun 24 09:55:21 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:21 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-09c95587-05e5-47a3-9898-c860375173a9 tempest-VolumesGetTest-696686733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8e4cf6b7-87a4-4cfb-8984-007adf5b2253" returned: 0 in 1.431s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-09c95587-05e5-47a3-9898-c860375173a9 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8e4cf6b7-87a4-4cfb-8984-007adf5b2253 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:21 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8e4cf6b7-87a4-4cfb-8984-007adf5b2253 Jun 24 09:55:21 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:22 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286 1073741824" returned: 0 in 1.033s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:22 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b193f062-407d-407f-8057-63123c8d99e5 tempest-GroupsTest-1614604146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-44aba633-4a1c-46dd-a349-293a441e9394" returned: 0 in 0.948s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b193f062-407d-407f-8057-63123c8d99e5 tempest-GroupsTest-1614604146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-44aba633-4a1c-46dd-a349-293a441e9394 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:22 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-09c95587-05e5-47a3-9898-c860375173a9 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8e4cf6b7-87a4-4cfb-8984-007adf5b2253" returned: 0 in 0.850s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:22 devstack sudo[104871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-44aba633-4a1c-46dd-a349-293a441e9394 Jun 24 09:55:22 devstack sudo[104871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:22 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286 Jun 24 09:55:22 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:22 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-09c95587-05e5-47a3-9898-c860375173a9 tempest-VolumesGetTest-696686733 None] Lock "cinder-quobyte-8e4cf6b7-87a4-4cfb-8984-007adf5b2253" released by "delete_volume" :: held 2.383s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:22 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-09c95587-05e5-47a3-9898-c860375173a9 tempest-VolumesGetTest-696686733 None] Created reservations ['becf3e3d-e73f-4a69-9da3-2d8d0f827640', '989984e1-58b2-4615-8c65-50120185eefc', 'cdd3dd8a-bbe4-401b-8cb9-ebf9925ca56b', '8d4f577b-5ded-46e3-969b-e91f7b71f090'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:55:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-09c95587-05e5-47a3-9898-c860375173a9 tempest-VolumesGetTest-696686733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-09c95587-05e5-47a3-9898-c860375173a9 tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:22 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-09c95587-05e5-47a3-9898-c860375173a9 tempest-VolumesGetTest-696686733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:22 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-09c95587-05e5-47a3-9898-c860375173a9 tempest-VolumesGetTest-696686733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-09c95587-05e5-47a3-9898-c860375173a9 tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-09c95587-05e5-47a3-9898-c860375173a9 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:22 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:55:22 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:23 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286" returned: 0 in 0.674s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:23 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:55:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656af438-dab2-4c75-9866-34eb5c80f8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a8e02d2-49b5-4fde-8201-f198f7605286', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5047cfd-2f6b-4bcb-9e12-b4042d8e8333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:23 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Volume volume-2a8e02d2-49b5-4fde-8201-f198f7605286 (2a8e02d2-49b5-4fde-8201-f198f7605286): created successfully Jun 24 09:55:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5047cfd-2f6b-4bcb-9e12-b4042d8e8333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Flow 'volume_create_manager' (5b86669d-513c-4f54-bea6-147b61531ee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:55:23 devstack sudo[104871]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b193f062-407d-407f-8057-63123c8d99e5 tempest-GroupsTest-1614604146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-44aba633-4a1c-46dd-a349-293a441e9394" returned: 0 in 0.739s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:23 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-1a69a25f-c942-477e-bc34-1320134aef51 req-81e05ba8-b3cc-4690-92c9-d571d4577dff tempest-VolumesSnapshotsTestJSON-1713560722 None] Created volume successfully. Jun 24 09:55:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b193f062-407d-407f-8057-63123c8d99e5 tempest-GroupsTest-1614604146 None] Lock "cinder-quobyte-44aba633-4a1c-46dd-a349-293a441e9394" released by "delete_volume" :: held 1.745s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:23 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-b193f062-407d-407f-8057-63123c8d99e5 tempest-GroupsTest-1614604146 None] Created reservations ['1c29243e-58a4-4710-b7e6-f487b7fde3ee'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:55:23 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-09c95587-05e5-47a3-9898-c860375173a9 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.719s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:23 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-09c95587-05e5-47a3-9898-c860375173a9 tempest-VolumesGetTest-696686733 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:55:23 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-09c95587-05e5-47a3-9898-c860375173a9 tempest-VolumesGetTest-696686733 None] Deleted volume successfully. Jun 24 09:55:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-09c95587-05e5-47a3-9898-c860375173a9 tempest-VolumesGetTest-696686733 None] Lock "cinder-8e4cf6b7-87a4-4cfb-8984-007adf5b2253-delete_volume" released by "delete_volume" :: held 3.397s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:23 devstack cinder-volume[93447]: WARNING cinder.quota [None req-b193f062-407d-407f-8057-63123c8d99e5 tempest-GroupsTest-1614604146 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1665908559 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1665908559, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:55:23 devstack cinder-volume[93447]: WARNING cinder.quota [None req-b193f062-407d-407f-8057-63123c8d99e5 tempest-GroupsTest-1614604146 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1665908559 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1665908559, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:55:23 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-b193f062-407d-407f-8057-63123c8d99e5 tempest-GroupsTest-1614604146 None] Created reservations ['b8a94ca5-1d5b-42bf-8356-cf980a10c7c0', '6c230d70-2fb9-4512-ba71-586d3b8a8b76', 'a15833c6-b22a-4326-bc41-9ae99a87c832', 'bf2e00e5-4259-45b4-8336-0d740b0b4f28'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:55:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b193f062-407d-407f-8057-63123c8d99e5 tempest-GroupsTest-1614604146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b193f062-407d-407f-8057-63123c8d99e5 tempest-GroupsTest-1614604146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:23 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b193f062-407d-407f-8057-63123c8d99e5 tempest-GroupsTest-1614604146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:23 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b193f062-407d-407f-8057-63123c8d99e5 tempest-GroupsTest-1614604146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b193f062-407d-407f-8057-63123c8d99e5 tempest-GroupsTest-1614604146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b193f062-407d-407f-8057-63123c8d99e5 tempest-GroupsTest-1614604146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5b039438-faa1-4abe-a61c-76f1aab64529 tempest-VolumesGetTest-696686733 None] Acquiring lock "cinder-1583379b-a351-4b9d-a354-439520595044-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:23 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:55:23 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5b039438-faa1-4abe-a61c-76f1aab64529 tempest-VolumesGetTest-696686733 None] Lock "cinder-1583379b-a351-4b9d-a354-439520595044-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:24 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5b039438-faa1-4abe-a61c-76f1aab64529 tempest-VolumesGetTest-696686733 None] Acquiring lock "cinder-quobyte-1583379b-a351-4b9d-a354-439520595044" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:24 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5b039438-faa1-4abe-a61c-76f1aab64529 tempest-VolumesGetTest-696686733 None] Lock "cinder-quobyte-1583379b-a351-4b9d-a354-439520595044" acquired by "delete_volume" :: waited 0.025s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:24 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c2a46e-4329-4cb4-933e-32dcf851e993]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5b039438-faa1-4abe-a61c-76f1aab64529 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-f29ad62a-9935-42d5-9789-6cbb4eddd1b0 req-da8330f0-0a8c-4b77-b393-80887c20fbc4 tempest-VolumesSnapshotsTestJSON-1713560722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-f29ad62a-9935-42d5-9789-6cbb4eddd1b0 req-da8330f0-0a8c-4b77-b393-80887c20fbc4 tempest-VolumesSnapshotsTestJSON-1713560722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [req-f29ad62a-9935-42d5-9789-6cbb4eddd1b0 req-da8330f0-0a8c-4b77-b393-80887c20fbc4 tempest-VolumesSnapshotsTestJSON-1713560722 None] Creating offline snapshot 993b1431-be1d-4187-8a0f-d331b4415a07 of volume 2a8e02d2-49b5-4fde-8201-f198f7605286 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 09:55:24 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cdb530-eca4-43f9-af26-c249faa74464]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-f29ad62a-9935-42d5-9789-6cbb4eddd1b0 req-da8330f0-0a8c-4b77-b393-80887c20fbc4 tempest-VolumesSnapshotsTestJSON-1713560722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:24 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044 Jun 24 09:55:24 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:24 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286 Jun 24 09:55:24 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:24 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-d2cb7967-2e39-453c-8097-268d4310d7a5 tempest-GroupsTest-1614604146 None] Created reservations ['fd3db82b-4d21-41a6-bbdc-11dff437aaa0'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:55:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d2cb7967-2e39-453c-8097-268d4310d7a5 tempest-GroupsTest-1614604146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d2cb7967-2e39-453c-8097-268d4310d7a5 tempest-GroupsTest-1614604146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb7967-2e39-453c-8097-268d4310d7a5 tempest-GroupsTest-1614604146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d2cb7967-2e39-453c-8097-268d4310d7a5 tempest-GroupsTest-1614604146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d2cb7967-2e39-453c-8097-268d4310d7a5 tempest-GroupsTest-1614604146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d2cb7967-2e39-453c-8097-268d4310d7a5 tempest-GroupsTest-1614604146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:24 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:55:24 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:24 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b193f062-407d-407f-8057-63123c8d99e5 tempest-GroupsTest-1614604146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.773s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:24 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-b193f062-407d-407f-8057-63123c8d99e5 tempest-GroupsTest-1614604146 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:55:24 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-b193f062-407d-407f-8057-63123c8d99e5 tempest-GroupsTest-1614604146 None] Delete group completed successfully. Jun 24 09:55:24 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:24 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:55:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5b039438-faa1-4abe-a61c-76f1aab64529 tempest-VolumesGetTest-696686733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044" returned: 0 in 0.912s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5b039438-faa1-4abe-a61c-76f1aab64529 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:25 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:55:25 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:25 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044 Jun 24 09:55:25 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:25 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-f29ad62a-9935-42d5-9789-6cbb4eddd1b0 req-da8330f0-0a8c-4b77-b393-80887c20fbc4 tempest-VolumesSnapshotsTestJSON-1713560722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286" returned: 0 in 0.956s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-f29ad62a-9935-42d5-9789-6cbb4eddd1b0 req-da8330f0-0a8c-4b77-b393-80887c20fbc4 tempest-VolumesSnapshotsTestJSON-1713560722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.993b1431-be1d-4187-8a0f-d331b4415a07 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:25 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.993b1431-be1d-4187-8a0f-d331b4415a07 1G Jun 24 09:55:25 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:25 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d2cb7967-2e39-453c-8097-268d4310d7a5 tempest-GroupsTest-1614604146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.826s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-d2cb7967-2e39-453c-8097-268d4310d7a5 tempest-GroupsTest-1614604146 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:55:25 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-d2cb7967-2e39-453c-8097-268d4310d7a5 tempest-GroupsTest-1614604146 None] Delete group completed successfully. Jun 24 09:55:25 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.848s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:55:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:55:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 8 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 09:55:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 09:55:26 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5b039438-faa1-4abe-a61c-76f1aab64529 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1583379b-a351-4b9d-a354-439520595044" returned: 0 in 0.978s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:26 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5b039438-faa1-4abe-a61c-76f1aab64529 tempest-VolumesGetTest-696686733 None] Lock "cinder-quobyte-1583379b-a351-4b9d-a354-439520595044" released by "delete_volume" :: held 2.008s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:26 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-5b039438-faa1-4abe-a61c-76f1aab64529 tempest-VolumesGetTest-696686733 None] Created reservations ['ad9257e1-c0d2-4c8b-aeb7-7d4262546ffc', '03dda8b1-d449-40dc-ad49-be4bf4fafd01', 'b7a2602c-ee26-4a16-b1df-fb010435c9be', 'ece5655b-a4a0-49a2-9168-b980506b5333'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:55:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5b039438-faa1-4abe-a61c-76f1aab64529 tempest-VolumesGetTest-696686733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5b039438-faa1-4abe-a61c-76f1aab64529 tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-5b039438-faa1-4abe-a61c-76f1aab64529 tempest-VolumesGetTest-696686733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-5b039438-faa1-4abe-a61c-76f1aab64529 tempest-VolumesGetTest-696686733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5b039438-faa1-4abe-a61c-76f1aab64529 tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5b039438-faa1-4abe-a61c-76f1aab64529 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:26 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:26 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:55:26 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-f29ad62a-9935-42d5-9789-6cbb4eddd1b0 req-da8330f0-0a8c-4b77-b393-80887c20fbc4 tempest-VolumesSnapshotsTestJSON-1713560722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.993b1431-be1d-4187-8a0f-d331b4415a07 1G" returned: 0 in 1.313s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-f29ad62a-9935-42d5-9789-6cbb4eddd1b0 req-da8330f0-0a8c-4b77-b393-80887c20fbc4 tempest-VolumesSnapshotsTestJSON-1713560722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a8e02d2-49b5-4fde-8201-f198f7605286 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.993b1431-be1d-4187-8a0f-d331b4415a07 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:26 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-4e5b0dad-e574-4277-889c-12667e3ed687 tempest-GroupsTest-1614604146 None] Group tempest-GroupsTest-Group-660353670: creating Jun 24 09:55:26 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a8e02d2-49b5-4fde-8201-f198f7605286 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.993b1431-be1d-4187-8a0f-d331b4415a07 Jun 24 09:55:26 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:26 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-4e5b0dad-e574-4277-889c-12667e3ed687 tempest-GroupsTest-1614604146 None] Group tempest-GroupsTest-Group-660353670: created successfully Jun 24 09:55:26 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-4e5b0dad-e574-4277-889c-12667e3ed687 tempest-GroupsTest-1614604146 None] Create group completed successfully. Jun 24 09:55:27 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5b039438-faa1-4abe-a61c-76f1aab64529 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.239s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:27 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-5b039438-faa1-4abe-a61c-76f1aab64529 tempest-VolumesGetTest-696686733 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:55:27 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-5b039438-faa1-4abe-a61c-76f1aab64529 tempest-VolumesGetTest-696686733 None] Deleted volume successfully. Jun 24 09:55:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5b039438-faa1-4abe-a61c-76f1aab64529 tempest-VolumesGetTest-696686733 None] Lock "cinder-1583379b-a351-4b9d-a354-439520595044-delete_volume" released by "delete_volume" :: held 3.683s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:27 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-f29ad62a-9935-42d5-9789-6cbb4eddd1b0 req-da8330f0-0a8c-4b77-b393-80887c20fbc4 tempest-VolumesSnapshotsTestJSON-1713560722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a8e02d2-49b5-4fde-8201-f198f7605286 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.993b1431-be1d-4187-8a0f-d331b4415a07" returned: 0 in 1.232s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:27 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [req-f29ad62a-9935-42d5-9789-6cbb4eddd1b0 req-da8330f0-0a8c-4b77-b393-80887c20fbc4 tempest-VolumesSnapshotsTestJSON-1713560722 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.993b1431-be1d-4187-8a0f-d331b4415a07 is being set with open permissions: ugo+rw Jun 24 09:55:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-f29ad62a-9935-42d5-9789-6cbb4eddd1b0 req-da8330f0-0a8c-4b77-b393-80887c20fbc4 tempest-VolumesSnapshotsTestJSON-1713560722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.993b1431-be1d-4187-8a0f-d331b4415a07 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:27 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.993b1431-be1d-4187-8a0f-d331b4415a07 Jun 24 09:55:27 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:28 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:55:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Flow 'volume_create_manager' (66baef94-26c3-4278-8a7f-3df4235f5775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:55:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a91b0cb-d63d-4fbc-9ed9-9f223247a583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a91b0cb-d63d-4fbc-9ed9-9f223247a583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-660663184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=104e7a6b-414a-4d92-bac5-b0d590e13bfe,host='devstack@QuobyteHD#QuobyteHD',id=cc4ab526-4ce9-4656-9df7-8ffa33dfe74f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6abfbade21a940a38075d89f33cf911a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:55:29Z,use_quota=True,user_id='e0b7609370764b39bd703b2c2b14c4e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea003ef4-371d-4037-a474-4f407121dbf6),volume_type_id=ea003ef4-371d-4037-a474-4f407121dbf6)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f50c8c-7c67-4f51-9fa7-c6977dc78a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f50c8c-7c67-4f51-9fa7-c6977dc78a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21366bcb-6afc-46e0-86e8-5d63ef96233e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21366bcb-6afc-46e0-86e8-5d63ef96233e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc4ab526-4ce9-4656-9df7-8ffa33dfe74f', 'volume_name': 'volume-cc4ab526-4ce9-4656-9df7-8ffa33dfe74f', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a4cac16-8f44-4986-af5a-6bc67c0c09a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a4cac16-8f44-4986-af5a-6bc67c0c09a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4d129d-f586-4f1b-be92-32623f6f9146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:28 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Volume cc4ab526-4ce9-4656-9df7-8ffa33dfe74f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc4ab526-4ce9-4656-9df7-8ffa33dfe74f', 'volume_size': 1} Jun 24 09:55:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:28 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-f29ad62a-9935-42d5-9789-6cbb4eddd1b0 req-da8330f0-0a8c-4b77-b393-80887c20fbc4 tempest-VolumesSnapshotsTestJSON-1713560722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.993b1431-be1d-4187-8a0f-d331b4415a07" returned: 0 in 1.143s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-f29ad62a-9935-42d5-9789-6cbb4eddd1b0 req-da8330f0-0a8c-4b77-b393-80887c20fbc4 tempest-VolumesSnapshotsTestJSON-1713560722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:28 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.info Jun 24 09:55:28 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:29 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:55:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Flow 'volume_create_manager' (52c5cc72-c273-422c-a2cc-6eb3cdaae979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:55:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ec2edc-730a-4706-b786-369954521cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ec2edc-730a-4706-b786-369954521cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1622375323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be841e04-c8f2-4dd4-abbc-14c647fcac94,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1cf94bf08bf443c0a23eaf5ac03f0314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:55:29Z,use_quota=True,user_id='1808a15ca11b48ba8257f8fe9f81df6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7576e835-0c21-4010-a5fc-8d0d0d92f0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7576e835-0c21-4010-a5fc-8d0d0d92f0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2509dba-f704-458e-b643-1204e750486e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:29 devstack cinder-volume[93447]: DEBUG cinder.image.glance [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Creating Keystone auth plugin from conf {{(pid=93447) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 09:55:29 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-f29ad62a-9935-42d5-9789-6cbb4eddd1b0 req-da8330f0-0a8c-4b77-b393-80887c20fbc4 tempest-VolumesSnapshotsTestJSON-1713560722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.info" returned: 0 in 0.867s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:29 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [req-f29ad62a-9935-42d5-9789-6cbb4eddd1b0 req-da8330f0-0a8c-4b77-b393-80887c20fbc4 tempest-VolumesSnapshotsTestJSON-1713560722 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.info is being set with open permissions: ugo+rw Jun 24 09:55:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-f29ad62a-9935-42d5-9789-6cbb4eddd1b0 req-da8330f0-0a8c-4b77-b393-80887c20fbc4 tempest-VolumesSnapshotsTestJSON-1713560722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:29 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.info Jun 24 09:55:29 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2509dba-f704-458e-b643-1204e750486e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'be841e04-c8f2-4dd4-abbc-14c647fcac94', 'volume_name': 'volume-be841e04-c8f2-4dd4-abbc-14c647fcac94', 'volume_size': 1, 'image_id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48394558c0ae48f385c046476f3b062e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'created_at': datetime.datetime(2026, 6, 24, 7, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 7, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1024bacd-ca4f-4bf2-a3c5-fbb416f1bf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1024bacd-ca4f-4bf2-a3c5-fbb416f1bf86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (496e1889-bc2f-49ba-aaf1-5f4e7454b6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:29 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Volume be841e04-c8f2-4dd4-abbc-14c647fcac94: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-be841e04-c8f2-4dd4-abbc-14c647fcac94', 'volume_size': 1, 'image_id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48394558c0ae48f385c046476f3b062e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'created_at': datetime.datetime(2026, 6, 24, 7, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 7, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 24 09:55:29 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Trying to clone be841e04-c8f2-4dd4-abbc-14c647fcac94 from image cd371dd7-fca0-4345-9276-7b2a9b23d2c0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'metadata': {}}]). {{(pid=93447) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 09:55:30 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_0eenlx5mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 09:55:30 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Image download 20.69 MB at 20.69 MB/s Jun 24 09:55:30 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d959a278-7c41-4fb3-83aa-3b646c7eb66e]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_0eenlx5mdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:30 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_0eenlx5mdevstack@QuobyteHD Jun 24 09:55:30 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:30 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-f29ad62a-9935-42d5-9789-6cbb4eddd1b0 req-da8330f0-0a8c-4b77-b393-80887c20fbc4 tempest-VolumesSnapshotsTestJSON-1713560722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.info" returned: 0 in 1.053s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-f29ad62a-9935-42d5-9789-6cbb4eddd1b0 req-da8330f0-0a8c-4b77-b393-80887c20fbc4 tempest-VolumesSnapshotsTestJSON-1713560722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.738s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.078s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:30 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=104e7a6b-414a-4d92-bac5-b0d590e13bfe,created_at=2026-06-24T07:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-660663184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=104e7a6b-414a-4d92-bac5-b0d590e13bfe,host='devstack@QuobyteHD#QuobyteHD',id=cc4ab526-4ce9-4656-9df7-8ffa33dfe74f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6abfbade21a940a38075d89f33cf911a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:55:29Z,use_quota=True,user_id='e0b7609370764b39bd703b2c2b14c4e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea003ef4-371d-4037-a474-4f407121dbf6),volume_type_id=ea003ef4-371d-4037-a474-4f407121dbf6)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:55:30 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Creating volume cc4ab526-4ce9-4656-9df7-8ffa33dfe74f {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:55:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:30 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:30 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:30 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:55:30 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:55:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cc4ab526-4ce9-4656-9df7-8ffa33dfe74f 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:30 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cc4ab526-4ce9-4656-9df7-8ffa33dfe74f 1073741824 Jun 24 09:55:30 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:30 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-f29ad62a-9935-42d5-9789-6cbb4eddd1b0 req-da8330f0-0a8c-4b77-b393-80887c20fbc4 tempest-VolumesSnapshotsTestJSON-1713560722 None] Create snapshot completed successfully Jun 24 09:55:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-1042b2d5-2956-43a4-8cb3-d641fe271f95 req-0bc6dd52-40d7-4399-bebc-3a7d37d77ad2 tempest-VolumesSnapshotsTestJSON-1713560722 None] Acquiring lock "cinder-993b1431-be1d-4187-8a0f-d331b4415a07-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-1042b2d5-2956-43a4-8cb3-d641fe271f95 req-0bc6dd52-40d7-4399-bebc-3a7d37d77ad2 tempest-VolumesSnapshotsTestJSON-1713560722 None] Lock "cinder-993b1431-be1d-4187-8a0f-d331b4415a07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-1042b2d5-2956-43a4-8cb3-d641fe271f95 req-0bc6dd52-40d7-4399-bebc-3a7d37d77ad2 tempest-VolumesSnapshotsTestJSON-1713560722 None] Acquiring lock "cinder-quobyte-2a8e02d2-49b5-4fde-8201-f198f7605286" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-1042b2d5-2956-43a4-8cb3-d641fe271f95 req-0bc6dd52-40d7-4399-bebc-3a7d37d77ad2 tempest-VolumesSnapshotsTestJSON-1713560722 None] Lock "cinder-quobyte-2a8e02d2-49b5-4fde-8201-f198f7605286" acquired by "delete_snapshot" :: waited 0.044s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-1042b2d5-2956-43a4-8cb3-d641fe271f95 req-0bc6dd52-40d7-4399-bebc-3a7d37d77ad2 tempest-VolumesSnapshotsTestJSON-1713560722 None] Acquiring lock "cinder-quobyte-993b1431-be1d-4187-8a0f-d331b4415a07" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-1042b2d5-2956-43a4-8cb3-d641fe271f95 req-0bc6dd52-40d7-4399-bebc-3a7d37d77ad2 tempest-VolumesSnapshotsTestJSON-1713560722 None] Lock "cinder-quobyte-993b1431-be1d-4187-8a0f-d331b4415a07" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:31 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [req-1042b2d5-2956-43a4-8cb3-d641fe271f95 req-0bc6dd52-40d7-4399-bebc-3a7d37d77ad2 tempest-VolumesSnapshotsTestJSON-1713560722 None] Deleting offline snapshot 993b1431-be1d-4187-8a0f-d331b4415a07 of volume 2a8e02d2-49b5-4fde-8201-f198f7605286 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 09:55:31 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [req-1042b2d5-2956-43a4-8cb3-d641fe271f95 req-0bc6dd52-40d7-4399-bebc-3a7d37d77ad2 tempest-VolumesSnapshotsTestJSON-1713560722 None] snapshot_file for this snap is: volume-2a8e02d2-49b5-4fde-8201-f198f7605286.993b1431-be1d-4187-8a0f-d331b4415a07 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 09:55:31 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:31 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[218b19ae-60e2-4bfa-b38a-5ab8c2078cf3]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-1042b2d5-2956-43a4-8cb3-d641fe271f95 req-0bc6dd52-40d7-4399-bebc-3a7d37d77ad2 tempest-VolumesSnapshotsTestJSON-1713560722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.993b1431-be1d-4187-8a0f-d331b4415a07 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_0eenlx5mdevstack@QuobyteHD" returned: 0 in 1.334s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:31 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Temporary image cd371dd7-fca0-4345-9276-7b2a9b23d2c0 is fetched for user 1808a15ca11b48ba8257f8fe9f81df6d. {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 09:55:32 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[064f44c3-5e5b-4575-92fc-425e20dd8e4c]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_0eenlx5mdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:32 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.993b1431-be1d-4187-8a0f-d331b4415a07 Jun 24 09:55:32 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:32 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cc4ab526-4ce9-4656-9df7-8ffa33dfe74f 1073741824" returned: 0 in 1.229s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cc4ab526-4ce9-4656-9df7-8ffa33dfe74f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:32 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_0eenlx5mdevstack@QuobyteHD Jun 24 09:55:32 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:32 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cc4ab526-4ce9-4656-9df7-8ffa33dfe74f Jun 24 09:55:32 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:33 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cc4ab526-4ce9-4656-9df7-8ffa33dfe74f" returned: 0 in 0.909s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] <== create_volume: return (2187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:55:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.192s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:33 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4d129d-f586-4f1b-be92-32623f6f9146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc4ab526-4ce9-4656-9df7-8ffa33dfe74f', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:33 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb597d1-5a6b-4414-a857-b2373d184c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:33 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Volume volume-cc4ab526-4ce9-4656-9df7-8ffa33dfe74f (cc4ab526-4ce9-4656-9df7-8ffa33dfe74f): created successfully Jun 24 09:55:33 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb597d1-5a6b-4414-a857-b2373d184c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:33 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Flow 'volume_create_manager' (66baef94-26c3-4278-8a7f-3df4235f5775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:55:33 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-d21270cf-2f64-4f8d-96fa-1d4ef178e031 tempest-GroupsTest-1614604146 None] Created volume successfully. Jun 24 09:55:33 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-1042b2d5-2956-43a4-8cb3-d641fe271f95 req-0bc6dd52-40d7-4399-bebc-3a7d37d77ad2 tempest-VolumesSnapshotsTestJSON-1713560722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.993b1431-be1d-4187-8a0f-d331b4415a07" returned: 0 in 1.258s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [req-1042b2d5-2956-43a4-8cb3-d641fe271f95 req-0bc6dd52-40d7-4399-bebc-3a7d37d77ad2 tempest-VolumesSnapshotsTestJSON-1713560722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a8e02d2-49b5-4fde-8201-f198f7605286(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:55:33 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73efd21-062f-477d-91e3-c56f10a2fd8c]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-1042b2d5-2956-43a4-8cb3-d641fe271f95 req-0bc6dd52-40d7-4399-bebc-3a7d37d77ad2 tempest-VolumesSnapshotsTestJSON-1713560722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:33 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_0eenlx5mdevstack@QuobyteHD" returned: 0 in 1.195s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1622375323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be841e04-c8f2-4dd4-abbc-14c647fcac94,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1cf94bf08bf443c0a23eaf5ac03f0314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:55:29Z,use_quota=True,user_id='1808a15ca11b48ba8257f8fe9f81df6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:55:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Creating volume be841e04-c8f2-4dd4-abbc-14c647fcac94 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:55:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:55:33 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:55:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:33 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94 1073741824 Jun 24 09:55:33 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:33 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286 Jun 24 09:55:33 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:34 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-1042b2d5-2956-43a4-8cb3-d641fe271f95 req-0bc6dd52-40d7-4399-bebc-3a7d37d77ad2 tempest-VolumesSnapshotsTestJSON-1713560722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286" returned: 0 in 0.960s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-1042b2d5-2956-43a4-8cb3-d641fe271f95 req-0bc6dd52-40d7-4399-bebc-3a7d37d77ad2 tempest-VolumesSnapshotsTestJSON-1713560722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.993b1431-be1d-4187-8a0f-d331b4415a07 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:34 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94 1073741824" returned: 0 in 0.950s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:34 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.993b1431-be1d-4187-8a0f-d331b4415a07 Jun 24 09:55:34 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:34 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94 Jun 24 09:55:34 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:34 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:55:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Flow 'volume_create_manager' (f33af4a3-ff49-4c86-b99b-b564a2dc5dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:55:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7720c4-6ff1-4e4f-992f-22ecb1c41d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7720c4-6ff1-4e4f-992f-22ecb1c41d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1305993173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=104e7a6b-414a-4d92-bac5-b0d590e13bfe,host='devstack@QuobyteHD#QuobyteHD',id=d424dc5f-16d6-443c-9fa2-937a55476b8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6abfbade21a940a38075d89f33cf911a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:55:34Z,use_quota=True,user_id='e0b7609370764b39bd703b2c2b14c4e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea003ef4-371d-4037-a474-4f407121dbf6),volume_type_id=ea003ef4-371d-4037-a474-4f407121dbf6)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fef9062-8365-4b1a-bc44-4205980f8fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fef9062-8365-4b1a-bc44-4205980f8fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64517782-6927-4274-8395-bcfa942028ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64517782-6927-4274-8395-bcfa942028ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd424dc5f-16d6-443c-9fa2-937a55476b8f', 'volume_name': 'volume-d424dc5f-16d6-443c-9fa2-937a55476b8f', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513a2a3a-d1c7-4867-8b7b-d97105bfcebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513a2a3a-d1c7-4867-8b7b-d97105bfcebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93d366cc-9a95-4116-97be-c51a9e24a151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:34 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Volume d424dc5f-16d6-443c-9fa2-937a55476b8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d424dc5f-16d6-443c-9fa2-937a55476b8f', 'volume_size': 1} Jun 24 09:55:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:35 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94" returned: 0 in 0.870s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:35 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:55:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.508s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:35 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=104e7a6b-414a-4d92-bac5-b0d590e13bfe,created_at=2026-06-24T07:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1305993173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=104e7a6b-414a-4d92-bac5-b0d590e13bfe,host='devstack@QuobyteHD#QuobyteHD',id=d424dc5f-16d6-443c-9fa2-937a55476b8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6abfbade21a940a38075d89f33cf911a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:55:34Z,use_quota=True,user_id='e0b7609370764b39bd703b2c2b14c4e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea003ef4-371d-4037-a474-4f407121dbf6),volume_type_id=ea003ef4-371d-4037-a474-4f407121dbf6)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:55:35 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Creating volume d424dc5f-16d6-443c-9fa2-937a55476b8f {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:55:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:35 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:35 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:35 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:55:35 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:55:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d424dc5f-16d6-443c-9fa2-937a55476b8f 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:35 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d424dc5f-16d6-443c-9fa2-937a55476b8f 1073741824 Jun 24 09:55:35 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:35 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Attempting download of cd371dd7-fca0-4345-9276-7b2a9b23d2c0 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'metadata': {}}])) to volume be841e04-c8f2-4dd4-abbc-14c647fcac94. {{(pid=93447) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 09:55:35 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-1042b2d5-2956-43a4-8cb3-d641fe271f95 req-0bc6dd52-40d7-4399-bebc-3a7d37d77ad2 tempest-VolumesSnapshotsTestJSON-1713560722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.993b1431-be1d-4187-8a0f-d331b4415a07" returned: 0 in 1.021s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-1042b2d5-2956-43a4-8cb3-d641fe271f95 req-0bc6dd52-40d7-4399-bebc-3a7d37d77ad2 tempest-VolumesSnapshotsTestJSON-1713560722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.993b1431-be1d-4187-8a0f-d331b4415a07 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:35 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.993b1431-be1d-4187-8a0f-d331b4415a07 Jun 24 09:55:35 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:35 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4b8afd-786f-43de-babb-5439531b0c26]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_j8we6k7m {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:35 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_j8we6k7m Jun 24 09:55:35 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:35 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-1042b2d5-2956-43a4-8cb3-d641fe271f95 req-0bc6dd52-40d7-4399-bebc-3a7d37d77ad2 tempest-VolumesSnapshotsTestJSON-1713560722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286.993b1431-be1d-4187-8a0f-d331b4415a07" returned: 0 in 0.751s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-1042b2d5-2956-43a4-8cb3-d641fe271f95 req-0bc6dd52-40d7-4399-bebc-3a7d37d77ad2 tempest-VolumesSnapshotsTestJSON-1713560722 None] Lock "cinder-quobyte-993b1431-be1d-4187-8a0f-d331b4415a07" released by "_delete_snapshot" :: held 4.153s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-1042b2d5-2956-43a4-8cb3-d641fe271f95 req-0bc6dd52-40d7-4399-bebc-3a7d37d77ad2 tempest-VolumesSnapshotsTestJSON-1713560722 None] Lock "cinder-quobyte-2a8e02d2-49b5-4fde-8201-f198f7605286" released by "delete_snapshot" :: held 4.196s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:36 devstack cinder-volume[93447]: DEBUG cinder.quota [req-1042b2d5-2956-43a4-8cb3-d641fe271f95 req-0bc6dd52-40d7-4399-bebc-3a7d37d77ad2 tempest-VolumesSnapshotsTestJSON-1713560722 None] Created reservations ['be181255-0201-4551-8641-3305e1c63349', '57d51e22-174e-41a8-ae1c-74a499fb9116', '64383601-9659-4c76-8916-dd3da39e9f10', '93ff4ccd-385d-4ac1-874b-76d1d325a002'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:55:36 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d424dc5f-16d6-443c-9fa2-937a55476b8f 1073741824" returned: 0 in 1.160s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d424dc5f-16d6-443c-9fa2-937a55476b8f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:36 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-1042b2d5-2956-43a4-8cb3-d641fe271f95 req-0bc6dd52-40d7-4399-bebc-3a7d37d77ad2 tempest-VolumesSnapshotsTestJSON-1713560722 None] Delete snapshot completed successfully. Jun 24 09:55:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-1042b2d5-2956-43a4-8cb3-d641fe271f95 req-0bc6dd52-40d7-4399-bebc-3a7d37d77ad2 tempest-VolumesSnapshotsTestJSON-1713560722 None] Lock "cinder-993b1431-be1d-4187-8a0f-d331b4415a07-delete_snapshot" released by "delete_snapshot" :: held 4.585s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:36 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d424dc5f-16d6-443c-9fa2-937a55476b8f Jun 24 09:55:36 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:36 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_j8we6k7m" returned: 0 in 1.148s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_j8we6k7m {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:36 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_j8we6k7m Jun 24 09:55:36 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:37 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d424dc5f-16d6-443c-9fa2-937a55476b8f" returned: 0 in 0.733s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:37 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:55:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.964s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:37 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93d366cc-9a95-4116-97be-c51a9e24a151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d424dc5f-16d6-443c-9fa2-937a55476b8f', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:37 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f84125e6-ddcf-4bad-b28c-48eca7f357c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:37 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Volume volume-d424dc5f-16d6-443c-9fa2-937a55476b8f (d424dc5f-16d6-443c-9fa2-937a55476b8f): created successfully Jun 24 09:55:37 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f84125e6-ddcf-4bad-b28c-48eca7f357c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:37 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Flow 'volume_create_manager' (f33af4a3-ff49-4c86-b99b-b564a2dc5dd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:55:37 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-f2e8ba31-d02c-446c-b286-5388a8e42e6c tempest-GroupsTest-1614604146 None] Created volume successfully. Jun 24 09:55:37 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_j8we6k7m" returned: 1 in 0.821s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_j8we6k7m' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 09:55:37 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[317cd626-3e5c-48e8-8705-83d9cbd9d655]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_0eenlx5mdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:37 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-48cc5953-9087-4ba2-8956-50642e39eab5 req-daffc43b-44ce-4cb7-b003-d4f640028c8d tempest-VolumesSnapshotsTestJSON-1713560722 None] Acquiring lock "cinder-2a8e02d2-49b5-4fde-8201-f198f7605286-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:37 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-48cc5953-9087-4ba2-8956-50642e39eab5 req-daffc43b-44ce-4cb7-b003-d4f640028c8d tempest-VolumesSnapshotsTestJSON-1713560722 None] Lock "cinder-2a8e02d2-49b5-4fde-8201-f198f7605286-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:37 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_0eenlx5mdevstack@QuobyteHD Jun 24 09:55:37 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:37 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-48cc5953-9087-4ba2-8956-50642e39eab5 req-daffc43b-44ce-4cb7-b003-d4f640028c8d tempest-VolumesSnapshotsTestJSON-1713560722 None] Acquiring lock "cinder-quobyte-2a8e02d2-49b5-4fde-8201-f198f7605286" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:37 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-48cc5953-9087-4ba2-8956-50642e39eab5 req-daffc43b-44ce-4cb7-b003-d4f640028c8d tempest-VolumesSnapshotsTestJSON-1713560722 None] Lock "cinder-quobyte-2a8e02d2-49b5-4fde-8201-f198f7605286" acquired by "delete_volume" :: waited 0.018s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:37 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d75511-d4af-4bb3-b12f-c60e9f135965]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-48cc5953-9087-4ba2-8956-50642e39eab5 req-daffc43b-44ce-4cb7-b003-d4f640028c8d tempest-VolumesSnapshotsTestJSON-1713560722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:37 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286 Jun 24 09:55:37 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:38 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_0eenlx5mdevstack@QuobyteHD" returned: 0 in 0.911s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:38 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] cd371dd7-fca0-4345-9276-7b2a9b23d2c0 was qcow2, converting to raw {{(pid=93447) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 09:55:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_0eenlx5mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:38 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_0eenlx5mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94 Jun 24 09:55:38 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:38 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-48cc5953-9087-4ba2-8956-50642e39eab5 req-daffc43b-44ce-4cb7-b003-d4f640028c8d tempest-VolumesSnapshotsTestJSON-1713560722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286" returned: 0 in 0.808s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-48cc5953-9087-4ba2-8956-50642e39eab5 req-daffc43b-44ce-4cb7-b003-d4f640028c8d tempest-VolumesSnapshotsTestJSON-1713560722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:38 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286 Jun 24 09:55:38 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:38 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-f35715d6-312e-494a-948f-16df8ebd49f1 tempest-GroupsTest-1614604146 None] Update group completed successfully. Jun 24 09:55:39 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-48cc5953-9087-4ba2-8956-50642e39eab5 req-daffc43b-44ce-4cb7-b003-d4f640028c8d tempest-VolumesSnapshotsTestJSON-1713560722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2a8e02d2-49b5-4fde-8201-f198f7605286" returned: 0 in 0.822s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-48cc5953-9087-4ba2-8956-50642e39eab5 req-daffc43b-44ce-4cb7-b003-d4f640028c8d tempest-VolumesSnapshotsTestJSON-1713560722 None] Lock "cinder-quobyte-2a8e02d2-49b5-4fde-8201-f198f7605286" released by "delete_volume" :: held 1.727s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:39 devstack cinder-volume[93447]: DEBUG cinder.quota [req-48cc5953-9087-4ba2-8956-50642e39eab5 req-daffc43b-44ce-4cb7-b003-d4f640028c8d tempest-VolumesSnapshotsTestJSON-1713560722 None] Created reservations ['7a178258-2394-4044-bda2-59fa464b6076', 'a1f00cf4-e691-4497-8ced-cd8daf060de4', '5ae332e4-d3a3-4087-ade3-c4c58ec912cd', '347e27e8-fa21-4d79-b008-ba08c69135c4'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:55:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-48cc5953-9087-4ba2-8956-50642e39eab5 req-daffc43b-44ce-4cb7-b003-d4f640028c8d tempest-VolumesSnapshotsTestJSON-1713560722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-48cc5953-9087-4ba2-8956-50642e39eab5 req-daffc43b-44ce-4cb7-b003-d4f640028c8d tempest-VolumesSnapshotsTestJSON-1713560722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [req-48cc5953-9087-4ba2-8956-50642e39eab5 req-daffc43b-44ce-4cb7-b003-d4f640028c8d tempest-VolumesSnapshotsTestJSON-1713560722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [req-48cc5953-9087-4ba2-8956-50642e39eab5 req-daffc43b-44ce-4cb7-b003-d4f640028c8d tempest-VolumesSnapshotsTestJSON-1713560722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-48cc5953-9087-4ba2-8956-50642e39eab5 req-daffc43b-44ce-4cb7-b003-d4f640028c8d tempest-VolumesSnapshotsTestJSON-1713560722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-48cc5953-9087-4ba2-8956-50642e39eab5 req-daffc43b-44ce-4cb7-b003-d4f640028c8d tempest-VolumesSnapshotsTestJSON-1713560722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:39 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:55:39 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:40 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-48cc5953-9087-4ba2-8956-50642e39eab5 req-daffc43b-44ce-4cb7-b003-d4f640028c8d tempest-VolumesSnapshotsTestJSON-1713560722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.797s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:40 devstack cinder-volume[93447]: DEBUG cinder.manager [req-48cc5953-9087-4ba2-8956-50642e39eab5 req-daffc43b-44ce-4cb7-b003-d4f640028c8d tempest-VolumesSnapshotsTestJSON-1713560722 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:55:40 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-48cc5953-9087-4ba2-8956-50642e39eab5 req-daffc43b-44ce-4cb7-b003-d4f640028c8d tempest-VolumesSnapshotsTestJSON-1713560722 None] Deleted volume successfully. Jun 24 09:55:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-48cc5953-9087-4ba2-8956-50642e39eab5 req-daffc43b-44ce-4cb7-b003-d4f640028c8d tempest-VolumesSnapshotsTestJSON-1713560722 None] Lock "cinder-2a8e02d2-49b5-4fde-8201-f198f7605286-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:40 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-07f8dd56-13dd-4ccb-887d-49ac6fec8d04 tempest-GroupsTest-1614604146 None] Update group completed successfully. Jun 24 09:55:40 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_0eenlx5mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94" returned: 0 in 2.437s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:40 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_0eenlx5mdevstack@QuobyteHD, size 112.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94 {{(pid=93447) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 09:55:40 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Converted 112.00 MB image at 45.94 MB/s Jun 24 09:55:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:40 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94 1G Jun 24 09:55:40 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:41 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94 1G" returned: 0 in 0.741s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:41 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc027368-fb15-42c0-bc21-c34728902f58]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:41 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94 Jun 24 09:55:41 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:42 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] Acquiring lock "cinder-quobyte-cc4ab526-4ce9-4656-9df7-8ffa33dfe74f" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:42 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] Lock "cinder-quobyte-cc4ab526-4ce9-4656-9df7-8ffa33dfe74f" acquired by "delete_volume" :: waited 0.022s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:42 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b66f021-7382-4634-8f6d-f7419ba9947c]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cc4ab526-4ce9-4656-9df7-8ffa33dfe74f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:42 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cc4ab526-4ce9-4656-9df7-8ffa33dfe74f Jun 24 09:55:42 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:42 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94" returned: 0 in 0.946s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:42 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94 Jun 24 09:55:42 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:42 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cc4ab526-4ce9-4656-9df7-8ffa33dfe74f" returned: 0 in 0.848s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cc4ab526-4ce9-4656-9df7-8ffa33dfe74f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:43 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cc4ab526-4ce9-4656-9df7-8ffa33dfe74f Jun 24 09:55:43 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:43 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94" returned: 1 in 0.822s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 09:55:43 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Downloaded image cd371dd7-fca0-4345-9276-7b2a9b23d2c0 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'metadata': {}}])) to volume be841e04-c8f2-4dd4-abbc-14c647fcac94 successfully. {{(pid=93447) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 09:55:43 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Temporary image cd371dd7-fca0-4345-9276-7b2a9b23d2c0 for user 1808a15ca11b48ba8257f8fe9f81df6d is deleted. {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 09:55:43 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Marking volume be841e04-c8f2-4dd4-abbc-14c647fcac94 as bootable. {{(pid=93447) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 09:55:43 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Copying metadata from image cd371dd7-fca0-4345-9276-7b2a9b23d2c0 to be841e04-c8f2-4dd4-abbc-14c647fcac94. {{(pid=93447) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 09:55:43 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Creating volume glance metadata for volume be841e04-c8f2-4dd4-abbc-14c647fcac94 backed by image cd371dd7-fca0-4345-9276-7b2a9b23d2c0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93447) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 09:55:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (496e1889-bc2f-49ba-aaf1-5f4e7454b6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be841e04-c8f2-4dd4-abbc-14c647fcac94', 'volume_size': 1, 'image_id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48394558c0ae48f385c046476f3b062e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'created_at': datetime.datetime(2026, 6, 24, 7, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 7, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e674ce4-1b6e-4863-bdd3-33d149d8f1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:43 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Volume volume-be841e04-c8f2-4dd4-abbc-14c647fcac94 (be841e04-c8f2-4dd4-abbc-14c647fcac94): created successfully Jun 24 09:55:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e674ce4-1b6e-4863-bdd3-33d149d8f1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Flow 'volume_create_manager' (52c5cc72-c273-422c-a2cc-6eb3cdaae979) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:55:43 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-1aa39ddb-e6f2-41ab-ae6b-3541614303f8 tempest-VolumesGetTest-696686733 None] Created volume successfully. Jun 24 09:55:43 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cc4ab526-4ce9-4656-9df7-8ffa33dfe74f" returned: 0 in 0.733s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] Lock "cinder-quobyte-cc4ab526-4ce9-4656-9df7-8ffa33dfe74f" released by "delete_volume" :: held 1.639s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] Acquiring lock "cinder-quobyte-d424dc5f-16d6-443c-9fa2-937a55476b8f" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] Lock "cinder-quobyte-d424dc5f-16d6-443c-9fa2-937a55476b8f" acquired by "delete_volume" :: waited 0.018s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:43 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[160906ed-44b9-41db-bc44-458f5f05d97c]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d424dc5f-16d6-443c-9fa2-937a55476b8f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:43 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d424dc5f-16d6-443c-9fa2-937a55476b8f Jun 24 09:55:43 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Flow 'volume_create_manager' (d3bd5043-a784-4ddd-91f1-e58bbcd2f520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ff86923-c3e5-432d-92cf-62b97a1bbcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ff86923-c3e5-432d-92cf-62b97a1bbcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:55:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1374181883',display_name='tempest-VolumesGetTest-Volume-1002908328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f13e8e0-8c59-413e-afca-6331376e3bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf94bf08bf443c0a23eaf5ac03f0314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:55:44Z,use_quota=True,user_id='1808a15ca11b48ba8257f8fe9f81df6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1444e2-2b20-4aa3-ae7b-5fdd61c6e80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1444e2-2b20-4aa3-ae7b-5fdd61c6e80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099ac0c8-999e-4849-9158-8d626aaab53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099ac0c8-999e-4849-9158-8d626aaab53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f13e8e0-8c59-413e-afca-6331376e3bd0', 'volume_name': 'volume-2f13e8e0-8c59-413e-afca-6331376e3bd0', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab394f8f-9175-4175-83ad-710d8b741b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab394f8f-9175-4175-83ad-710d8b741b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9ad254-a69b-42b2-b9c4-8da7fef1c511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:44 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Volume 2f13e8e0-8c59-413e-afca-6331376e3bd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f13e8e0-8c59-413e-afca-6331376e3bd0', 'volume_size': 1} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:55:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1374181883',display_name='tempest-VolumesGetTest-Volume-1002908328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f13e8e0-8c59-413e-afca-6331376e3bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf94bf08bf443c0a23eaf5ac03f0314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:55:44Z,use_quota=True,user_id='1808a15ca11b48ba8257f8fe9f81df6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Creating volume 2f13e8e0-8c59-413e-afca-6331376e3bd0 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:55:44 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2f13e8e0-8c59-413e-afca-6331376e3bd0 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:44 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2f13e8e0-8c59-413e-afca-6331376e3bd0 1073741824 Jun 24 09:55:44 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:44 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d424dc5f-16d6-443c-9fa2-937a55476b8f" returned: 0 in 0.920s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d424dc5f-16d6-443c-9fa2-937a55476b8f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:44 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d424dc5f-16d6-443c-9fa2-937a55476b8f Jun 24 09:55:44 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Flow 'volume_create_manager' (87fb9d4c-f375-4454-be09-6416dd459110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dbe4344-d40d-4bd1-b459-be39aa4c28bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dbe4344-d40d-4bd1-b459-be39aa4c28bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1862820979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47045ed6-1394-4f6d-a9d4-354c0aa78bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af18beff5594b70a9219b862e0abd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:55:45Z,use_quota=True,user_id='42b4be48a7b642f4b62ea0aafc8909fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77f95be-8f26-4625-aafe-74717f274890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77f95be-8f26-4625-aafe-74717f274890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807264f3-676c-484a-892b-819bb0a35c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807264f3-676c-484a-892b-819bb0a35c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47045ed6-1394-4f6d-a9d4-354c0aa78bf7', 'volume_name': 'volume-47045ed6-1394-4f6d-a9d4-354c0aa78bf7', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4450b87c-b933-4769-8698-ae3839e90de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4450b87c-b933-4769-8698-ae3839e90de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2aa6803-4644-4d1e-b710-e6ff6681c8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:45 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Volume 47045ed6-1394-4f6d-a9d4-354c0aa78bf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47045ed6-1394-4f6d-a9d4-354c0aa78bf7', 'volume_size': 1} Jun 24 09:55:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:45 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2f13e8e0-8c59-413e-afca-6331376e3bd0 1073741824" returned: 0 in 0.871s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2f13e8e0-8c59-413e-afca-6331376e3bd0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:45 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2f13e8e0-8c59-413e-afca-6331376e3bd0 Jun 24 09:55:45 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:45 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d424dc5f-16d6-443c-9fa2-937a55476b8f" returned: 0 in 0.678s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] Lock "cinder-quobyte-d424dc5f-16d6-443c-9fa2-937a55476b8f" released by "delete_volume" :: held 1.659s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:45 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] Created reservations ['bc80a815-87d6-4e78-8be7-7df9d4128ffe'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:55:45 devstack cinder-volume[93447]: WARNING cinder.quota [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2002006658 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2002006658, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:55:45 devstack cinder-volume[93447]: WARNING cinder.quota [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2002006658 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2002006658, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:55:45 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] Created reservations ['fc74ba50-80f2-46f0-b3fc-bc50c4154bdb', '58170a3e-498c-4363-98a3-121d5f07b690', 'f835920e-7c84-40c2-903f-0684675aa5b9', 'e63c1445-932e-4e09-bcf0-33c8155d6b35'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:55:45 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] Created reservations ['92b92236-94f6-42cf-af39-02e21a3343fc', 'de7b4f79-cc2c-42f8-855e-76e2669ef280', '022987eb-a4a1-4160-a420-5a4890355074', 'ac184a73-9354-4b49-b386-44ff00455169'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:55:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:45 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:45 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:45 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:55:45 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:46 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2f13e8e0-8c59-413e-afca-6331376e3bd0" returned: 0 in 0.742s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.018s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1862820979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47045ed6-1394-4f6d-a9d4-354c0aa78bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af18beff5594b70a9219b862e0abd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:55:45Z,use_quota=True,user_id='42b4be48a7b642f4b62ea0aafc8909fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Creating volume 47045ed6-1394-4f6d-a9d4-354c0aa78bf7 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:55:46 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47045ed6-1394-4f6d-a9d4-354c0aa78bf7 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9ad254-a69b-42b2-b9c4-8da7fef1c511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f13e8e0-8c59-413e-afca-6331376e3bd0', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0056af59-2afa-47ae-b64d-d5bb0e036319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:46 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47045ed6-1394-4f6d-a9d4-354c0aa78bf7 1073741824 Jun 24 09:55:46 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:46 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Volume volume-2f13e8e0-8c59-413e-afca-6331376e3bd0 (2f13e8e0-8c59-413e-afca-6331376e3bd0): created successfully Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0056af59-2afa-47ae-b64d-d5bb0e036319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Flow 'volume_create_manager' (d3bd5043-a784-4ddd-91f1-e58bbcd2f520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:55:46 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-9fad9300-feb4-44e5-8335-708fe5e5b314 tempest-VolumesGetTest-696686733 None] Created volume successfully. Jun 24 09:55:46 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.676s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:55:46 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-ab2ab064-6127-4c33-a25a-b5c927a30ef3 tempest-GroupsTest-1614604146 None] Delete group completed successfully. Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-98939857-d283-4b13-95fa-258fd17db0d5 tempest-VolumesGetTest-696686733 None] Acquiring lock "cinder-2f13e8e0-8c59-413e-afca-6331376e3bd0-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-98939857-d283-4b13-95fa-258fd17db0d5 tempest-VolumesGetTest-696686733 None] Lock "cinder-2f13e8e0-8c59-413e-afca-6331376e3bd0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-98939857-d283-4b13-95fa-258fd17db0d5 tempest-VolumesGetTest-696686733 None] Acquiring lock "cinder-quobyte-2f13e8e0-8c59-413e-afca-6331376e3bd0" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-98939857-d283-4b13-95fa-258fd17db0d5 tempest-VolumesGetTest-696686733 None] Lock "cinder-quobyte-2f13e8e0-8c59-413e-afca-6331376e3bd0" acquired by "delete_volume" :: waited 0.018s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a97972-03a8-4546-978a-4314c32fc5cd]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-98939857-d283-4b13-95fa-258fd17db0d5 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2f13e8e0-8c59-413e-afca-6331376e3bd0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:46 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2f13e8e0-8c59-413e-afca-6331376e3bd0 Jun 24 09:55:46 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:47 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47045ed6-1394-4f6d-a9d4-354c0aa78bf7 1073741824" returned: 0 in 0.995s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47045ed6-1394-4f6d-a9d4-354c0aa78bf7 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:47 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47045ed6-1394-4f6d-a9d4-354c0aa78bf7 Jun 24 09:55:47 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:47 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-98939857-d283-4b13-95fa-258fd17db0d5 tempest-VolumesGetTest-696686733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2f13e8e0-8c59-413e-afca-6331376e3bd0" returned: 0 in 1.040s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-98939857-d283-4b13-95fa-258fd17db0d5 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2f13e8e0-8c59-413e-afca-6331376e3bd0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:47 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2f13e8e0-8c59-413e-afca-6331376e3bd0 Jun 24 09:55:47 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:48 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47045ed6-1394-4f6d-a9d4-354c0aa78bf7" returned: 0 in 1.016s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:48 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:55:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2aa6803-4644-4d1e-b710-e6ff6681c8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47045ed6-1394-4f6d-a9d4-354c0aa78bf7', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d32d4890-57b0-46f3-ae30-0adbb0cfea48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:55:48 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Volume volume-47045ed6-1394-4f6d-a9d4-354c0aa78bf7 (47045ed6-1394-4f6d-a9d4-354c0aa78bf7): created successfully Jun 24 09:55:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d32d4890-57b0-46f3-ae30-0adbb0cfea48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:55:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Flow 'volume_create_manager' (87fb9d4c-f375-4454-be09-6416dd459110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:55:48 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-b7372837-ebad-4416-8dcb-651f3d307929 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Created volume successfully. Jun 24 09:55:48 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-98939857-d283-4b13-95fa-258fd17db0d5 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2f13e8e0-8c59-413e-afca-6331376e3bd0" returned: 0 in 0.789s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-98939857-d283-4b13-95fa-258fd17db0d5 tempest-VolumesGetTest-696686733 None] Lock "cinder-quobyte-2f13e8e0-8c59-413e-afca-6331376e3bd0" released by "delete_volume" :: held 1.877s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:48 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-98939857-d283-4b13-95fa-258fd17db0d5 tempest-VolumesGetTest-696686733 None] Created reservations ['c1ba463f-9bbc-4e2e-bd17-8813f1d37055', 'e1764a7f-960e-420a-82cb-5bf8b6eb6f93', '97634709-030f-46eb-83ca-77bbd3a6a766', '5b49aaf3-82f6-482a-a60b-330a4a7b2b6c'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:55:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-98939857-d283-4b13-95fa-258fd17db0d5 tempest-VolumesGetTest-696686733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-98939857-d283-4b13-95fa-258fd17db0d5 tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:48 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-98939857-d283-4b13-95fa-258fd17db0d5 tempest-VolumesGetTest-696686733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:48 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-98939857-d283-4b13-95fa-258fd17db0d5 tempest-VolumesGetTest-696686733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-98939857-d283-4b13-95fa-258fd17db0d5 tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-98939857-d283-4b13-95fa-258fd17db0d5 tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:48 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:55:48 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:49 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4b64d711-fbb0-4075-8c04-54fda79e59ee tempest-VolumesGetTest-696686733 None] Acquiring lock "cinder-be841e04-c8f2-4dd4-abbc-14c647fcac94-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:49 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4b64d711-fbb0-4075-8c04-54fda79e59ee tempest-VolumesGetTest-696686733 None] Lock "cinder-be841e04-c8f2-4dd4-abbc-14c647fcac94-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:49 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4b64d711-fbb0-4075-8c04-54fda79e59ee tempest-VolumesGetTest-696686733 None] Acquiring lock "cinder-quobyte-be841e04-c8f2-4dd4-abbc-14c647fcac94" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:49 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4b64d711-fbb0-4075-8c04-54fda79e59ee tempest-VolumesGetTest-696686733 None] Lock "cinder-quobyte-be841e04-c8f2-4dd4-abbc-14c647fcac94" acquired by "delete_volume" :: waited 0.015s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:49 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3d4ae1-339a-4bff-ae6e-7d44b5b01135]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4b64d711-fbb0-4075-8c04-54fda79e59ee tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:49 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94 Jun 24 09:55:49 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:49 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-98939857-d283-4b13-95fa-258fd17db0d5 tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.937s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:49 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-98939857-d283-4b13-95fa-258fd17db0d5 tempest-VolumesGetTest-696686733 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:55:49 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-98939857-d283-4b13-95fa-258fd17db0d5 tempest-VolumesGetTest-696686733 None] Deleted volume successfully. Jun 24 09:55:49 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-98939857-d283-4b13-95fa-258fd17db0d5 tempest-VolumesGetTest-696686733 None] Lock "cinder-2f13e8e0-8c59-413e-afca-6331376e3bd0-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:50 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4b64d711-fbb0-4075-8c04-54fda79e59ee tempest-VolumesGetTest-696686733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94" returned: 0 in 1.047s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4b64d711-fbb0-4075-8c04-54fda79e59ee tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:50 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94 Jun 24 09:55:50 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d8ea81e2-22a5-49c7-87f7-a4a19808eb43 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Acquiring lock "cinder-47045ed6-1394-4f6d-a9d4-354c0aa78bf7-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d8ea81e2-22a5-49c7-87f7-a4a19808eb43 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Lock "cinder-47045ed6-1394-4f6d-a9d4-354c0aa78bf7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d8ea81e2-22a5-49c7-87f7-a4a19808eb43 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Acquiring lock "cinder-quobyte-47045ed6-1394-4f6d-a9d4-354c0aa78bf7" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:55:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d8ea81e2-22a5-49c7-87f7-a4a19808eb43 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Lock "cinder-quobyte-47045ed6-1394-4f6d-a9d4-354c0aa78bf7" acquired by "delete_volume" :: waited 0.014s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:55:50 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9996ef1d-39bb-4412-912d-3c0d1494075e]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d8ea81e2-22a5-49c7-87f7-a4a19808eb43 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47045ed6-1394-4f6d-a9d4-354c0aa78bf7 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:50 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47045ed6-1394-4f6d-a9d4-354c0aa78bf7 Jun 24 09:55:50 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:51 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4b64d711-fbb0-4075-8c04-54fda79e59ee tempest-VolumesGetTest-696686733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94" returned: 1 in 0.807s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4b64d711-fbb0-4075-8c04-54fda79e59ee tempest-VolumesGetTest-696686733 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 09:55:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4b64d711-fbb0-4075-8c04-54fda79e59ee tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:51 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94 Jun 24 09:55:51 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:51 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d8ea81e2-22a5-49c7-87f7-a4a19808eb43 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47045ed6-1394-4f6d-a9d4-354c0aa78bf7" returned: 0 in 0.868s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d8ea81e2-22a5-49c7-87f7-a4a19808eb43 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47045ed6-1394-4f6d-a9d4-354c0aa78bf7 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:51 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47045ed6-1394-4f6d-a9d4-354c0aa78bf7 Jun 24 09:55:51 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:51 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4b64d711-fbb0-4075-8c04-54fda79e59ee tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-be841e04-c8f2-4dd4-abbc-14c647fcac94" returned: 0 in 0.716s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:51 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4b64d711-fbb0-4075-8c04-54fda79e59ee tempest-VolumesGetTest-696686733 None] Lock "cinder-quobyte-be841e04-c8f2-4dd4-abbc-14c647fcac94" released by "delete_volume" :: held 2.667s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:51 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-13ebdbf1-4ad0-42db-9e4c-0d567bbaa5b3 tempest-GroupsV320Test-355805654 None] Group tempest-GroupsV320Test-Group-427183063: creating Jun 24 09:55:51 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-13ebdbf1-4ad0-42db-9e4c-0d567bbaa5b3 tempest-GroupsV320Test-355805654 None] Group tempest-GroupsV320Test-Group-427183063: created successfully Jun 24 09:55:51 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-13ebdbf1-4ad0-42db-9e4c-0d567bbaa5b3 tempest-GroupsV320Test-355805654 None] Create group completed successfully. Jun 24 09:55:51 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-4b64d711-fbb0-4075-8c04-54fda79e59ee tempest-VolumesGetTest-696686733 None] Created reservations ['75dc1ca7-322a-4c32-8e9f-30c3581706d6', '9706cc52-29a6-4694-95e1-542397c5e2d3', 'da0acaa7-e344-474c-aaf7-3ed674e6d125', '845aae92-7f78-4f82-950a-b1a9fe830e41'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:55:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4b64d711-fbb0-4075-8c04-54fda79e59ee tempest-VolumesGetTest-696686733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4b64d711-fbb0-4075-8c04-54fda79e59ee tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:52 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4b64d711-fbb0-4075-8c04-54fda79e59ee tempest-VolumesGetTest-696686733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:52 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4b64d711-fbb0-4075-8c04-54fda79e59ee tempest-VolumesGetTest-696686733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4b64d711-fbb0-4075-8c04-54fda79e59ee tempest-VolumesGetTest-696686733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4b64d711-fbb0-4075-8c04-54fda79e59ee tempest-VolumesGetTest-696686733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:52 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:55:52 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:52 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d8ea81e2-22a5-49c7-87f7-a4a19808eb43 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47045ed6-1394-4f6d-a9d4-354c0aa78bf7" returned: 0 in 0.752s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:52 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d8ea81e2-22a5-49c7-87f7-a4a19808eb43 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Lock "cinder-quobyte-47045ed6-1394-4f6d-a9d4-354c0aa78bf7" released by "delete_volume" :: held 1.671s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:52 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-d8ea81e2-22a5-49c7-87f7-a4a19808eb43 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Created reservations ['197da98d-d021-470b-9f33-5a34656125c1', 'ac8b23aa-ece3-487d-9d5a-f90e0ba05124', '1774e8ba-c1f2-49b4-9ea4-cc194bd52541', '08022630-16e8-4aaa-8fde-8267af40f6f4'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:55:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d8ea81e2-22a5-49c7-87f7-a4a19808eb43 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d8ea81e2-22a5-49c7-87f7-a4a19808eb43 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:52 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d8ea81e2-22a5-49c7-87f7-a4a19808eb43 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:52 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d8ea81e2-22a5-49c7-87f7-a4a19808eb43 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d8ea81e2-22a5-49c7-87f7-a4a19808eb43 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d8ea81e2-22a5-49c7-87f7-a4a19808eb43 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:52 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:55:52 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:52 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4b64d711-fbb0-4075-8c04-54fda79e59ee tempest-VolumesGetTest-696686733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.698s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:52 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-4b64d711-fbb0-4075-8c04-54fda79e59ee tempest-VolumesGetTest-696686733 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:55:52 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-4b64d711-fbb0-4075-8c04-54fda79e59ee tempest-VolumesGetTest-696686733 None] Deleted volume successfully. Jun 24 09:55:52 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4b64d711-fbb0-4075-8c04-54fda79e59ee tempest-VolumesGetTest-696686733 None] Lock "cinder-be841e04-c8f2-4dd4-abbc-14c647fcac94-delete_volume" released by "delete_volume" :: held 3.634s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:53 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d8ea81e2-22a5-49c7-87f7-a4a19808eb43 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.803s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:53 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-d8ea81e2-22a5-49c7-87f7-a4a19808eb43 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:55:53 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-d8ea81e2-22a5-49c7-87f7-a4a19808eb43 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Deleted volume successfully. Jun 24 09:55:53 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d8ea81e2-22a5-49c7-87f7-a4a19808eb43 tempest-VolumeQuotasNegativeTestJSON-1629677837 None] Lock "cinder-47045ed6-1394-4f6d-a9d4-354c0aa78bf7-delete_volume" released by "delete_volume" :: held 2.719s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:55:53 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-c47f570b-bfad-4b87-81c4-5b9c49e5ad13 tempest-GroupsV320Test-355805654 None] Created reservations ['eef80009-132c-4e9a-9fce-8ece426fbbbd'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:55:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c47f570b-bfad-4b87-81c4-5b9c49e5ad13 tempest-GroupsV320Test-355805654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c47f570b-bfad-4b87-81c4-5b9c49e5ad13 tempest-GroupsV320Test-355805654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c47f570b-bfad-4b87-81c4-5b9c49e5ad13 tempest-GroupsV320Test-355805654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:55:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c47f570b-bfad-4b87-81c4-5b9c49e5ad13 tempest-GroupsV320Test-355805654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:55:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c47f570b-bfad-4b87-81c4-5b9c49e5ad13 tempest-GroupsV320Test-355805654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c47f570b-bfad-4b87-81c4-5b9c49e5ad13 tempest-GroupsV320Test-355805654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:53 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:55:53 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:54 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c47f570b-bfad-4b87-81c4-5b9c49e5ad13 tempest-GroupsV320Test-355805654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.717s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:54 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-c47f570b-bfad-4b87-81c4-5b9c49e5ad13 tempest-GroupsV320Test-355805654 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:55:54 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-c47f570b-bfad-4b87-81c4-5b9c49e5ad13 tempest-GroupsV320Test-355805654 None] Delete group completed successfully. Jun 24 09:55:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-27bc9339-e6e8-4e88-ad47-be31332df483 req-cad1c72a-995f-44a6-8ae8-f3784ff743ed tempest-TestServerVolumeAttachmentScenario-322011846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:55:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-27bc9339-e6e8-4e88-ad47-be31332df483 req-cad1c72a-995f-44a6-8ae8-f3784ff743ed tempest-TestServerVolumeAttachmentScenario-322011846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:55:55 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5388cf7-e7fd-4178-a16c-52611fd045a7]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:55:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-27bc9339-e6e8-4e88-ad47-be31332df483 req-cad1c72a-995f-44a6-8ae8-f3784ff743ed tempest-TestServerVolumeAttachmentScenario-322011846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:55:55 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706 Jun 24 09:55:55 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:55:56 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Jun 24 09:55:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-27bc9339-e6e8-4e88-ad47-be31332df483 req-cad1c72a-995f-44a6-8ae8-f3784ff743ed tempest-TestServerVolumeAttachmentScenario-322011846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706" returned: 0 in 0.965s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:55:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-27bc9339-e6e8-4e88-ad47-be31332df483 req-cad1c72a-995f-44a6-8ae8-f3784ff743ed tempest-TestServerVolumeAttachmentScenario-322011846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.996s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:55:56 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-27bc9339-e6e8-4e88-ad47-be31332df483 req-cad1c72a-995f-44a6-8ae8-f3784ff743ed tempest-TestServerVolumeAttachmentScenario-322011846 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb', 'name': 'volume-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68ede30c-d344-4767-bbe1-cbc7bfef8b03', 'enforce_multipath': True} {{(pid=93447) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 09:55:56 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-27bc9339-e6e8-4e88-ad47-be31332df483 req-cad1c72a-995f-44a6-8ae8-f3784ff743ed tempest-TestServerVolumeAttachmentScenario-322011846 None] attachment_update completed successfully. Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Flow 'volume_create_manager' (7988a3ab-c37d-47c1-91ea-ae2e15ca9f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f652e0-e57a-4ee3-810a-9e1d9fe2e864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f652e0-e57a-4ee3-810a-9e1d9fe2e864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1749220513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f73f88-556a-4760-843c-be1f805650bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d26650df61f439197e63cc72f97d6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:56:00Z,use_quota=True,user_id='bce1a4681a3c465396e8638980b8ddb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(578c5214-633d-4a27-a9f7-3cdedb545c97),volume_type_id=578c5214-633d-4a27-a9f7-3cdedb545c97)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b85080-1c2e-472f-a415-f189011d45af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1b85080-1c2e-472f-a415-f189011d45af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (935b2649-2c47-45fd-9fba-788b51e432c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (935b2649-2c47-45fd-9fba-788b51e432c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32f73f88-556a-4760-843c-be1f805650bc', 'volume_name': 'volume-32f73f88-556a-4760-843c-be1f805650bc', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a2ccbf-7f63-437e-87e1-82f4dc6f78e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a2ccbf-7f63-437e-87e1-82f4dc6f78e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf91e07-e682-42e7-bf99-8a4b172c38d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:00 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Volume 32f73f88-556a-4760-843c-be1f805650bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32f73f88-556a-4760-843c-be1f805650bc', 'volume_size': 1} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1749220513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f73f88-556a-4760-843c-be1f805650bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d26650df61f439197e63cc72f97d6fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:56:00Z,use_quota=True,user_id='bce1a4681a3c465396e8638980b8ddb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(578c5214-633d-4a27-a9f7-3cdedb545c97),volume_type_id=578c5214-633d-4a27-a9f7-3cdedb545c97)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Creating volume 32f73f88-556a-4760-843c-be1f805650bc {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:56:00 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-32f73f88-556a-4760-843c-be1f805650bc 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:56:00 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-32f73f88-556a-4760-843c-be1f805650bc 1073741824 Jun 24 09:56:00 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Flow 'volume_create_manager' (f3a587f0-7a58-43fc-9983-7667c8dd5ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c965a7b3-b8ee-402b-8878-784a3db032c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c965a7b3-b8ee-402b-8878-784a3db032c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-758181656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a974c6-9810-4336-b24a-6a3f83dea779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e529db43fc45bba047bca963649363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:56:00Z,use_quota=True,user_id='c0889a13840047aeb17882d44d67141f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dae7a051-16d8-4467-ba70-f1be1614f624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dae7a051-16d8-4467-ba70-f1be1614f624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19fa3813-84cf-4497-aa81-5282b3276d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19fa3813-84cf-4497-aa81-5282b3276d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36a974c6-9810-4336-b24a-6a3f83dea779', 'volume_name': 'volume-36a974c6-9810-4336-b24a-6a3f83dea779', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2926ce2e-3614-4ad4-8c45-ac022f0e6ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2926ce2e-3614-4ad4-8c45-ac022f0e6ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e164d8e-0cf3-4573-b37d-ac80c9d9610e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:00 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Volume 36a974c6-9810-4336-b24a-6a3f83dea779: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36a974c6-9810-4336-b24a-6a3f83dea779', 'volume_size': 1} Jun 24 09:56:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:56:01 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-32f73f88-556a-4760-843c-be1f805650bc 1073741824" returned: 0 in 0.914s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-32f73f88-556a-4760-843c-be1f805650bc {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:01 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-32f73f88-556a-4760-843c-be1f805650bc Jun 24 09:56:01 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:02 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-32f73f88-556a-4760-843c-be1f805650bc" returned: 0 in 0.735s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:02 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:56:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:56:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.591s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:56:02 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-758181656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a974c6-9810-4336-b24a-6a3f83dea779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7e529db43fc45bba047bca963649363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:56:00Z,use_quota=True,user_id='c0889a13840047aeb17882d44d67141f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:56:02 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Creating volume 36a974c6-9810-4336-b24a-6a3f83dea779 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:56:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:56:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:56:02 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:56:02 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:56:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:56:02 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:56:02 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:56:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-36a974c6-9810-4336-b24a-6a3f83dea779 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:02 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=140,cinder:INSERT=39,cinder:UPDATE=160,cinder:DELETE=13 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:56:02 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf91e07-e682-42e7-bf99-8a4b172c38d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32f73f88-556a-4760-843c-be1f805650bc', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:02 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780f1c57-f4a3-4e86-b863-84bf7826094b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:02 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-36a974c6-9810-4336-b24a-6a3f83dea779 1073741824 Jun 24 09:56:02 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:02 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=134,cinder:INSERT=47,cinder:UPDATE=172,cinder:DELETE=9 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:56:02 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Volume volume-32f73f88-556a-4760-843c-be1f805650bc (32f73f88-556a-4760-843c-be1f805650bc): created successfully Jun 24 09:56:02 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780f1c57-f4a3-4e86-b863-84bf7826094b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:02 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Flow 'volume_create_manager' (7988a3ab-c37d-47c1-91ea-ae2e15ca9f74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:56:02 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-d7995559-5fe7-46ee-b51b-d8df6fdbcacc tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Created volume successfully. Jun 24 09:56:03 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-36a974c6-9810-4336-b24a-6a3f83dea779 1073741824" returned: 0 in 1.039s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-36a974c6-9810-4336-b24a-6a3f83dea779 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:03 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-36a974c6-9810-4336-b24a-6a3f83dea779 Jun 24 09:56:03 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-46f73e0f-b68a-4d71-9dd6-6386ae17ff4d tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:56:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-46f73e0f-b68a-4d71-9dd6-6386ae17ff4d tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:56:04 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-46f73e0f-b68a-4d71-9dd6-6386ae17ff4d tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:56:04 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-46f73e0f-b68a-4d71-9dd6-6386ae17ff4d tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:56:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-46f73e0f-b68a-4d71-9dd6-6386ae17ff4d tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:56:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-46f73e0f-b68a-4d71-9dd6-6386ae17ff4d tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:04 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:56:04 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:04 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-36a974c6-9810-4336-b24a-6a3f83dea779" returned: 0 in 0.949s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:04 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] <== create_volume: return (2037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:56:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:56:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e164d8e-0cf3-4573-b37d-ac80c9d9610e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36a974c6-9810-4336-b24a-6a3f83dea779', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a1a2ada-0b7d-4712-82da-28172a2566f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:04 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Volume volume-36a974c6-9810-4336-b24a-6a3f83dea779 (36a974c6-9810-4336-b24a-6a3f83dea779): created successfully Jun 24 09:56:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a1a2ada-0b7d-4712-82da-28172a2566f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Flow 'volume_create_manager' (f3a587f0-7a58-43fc-9983-7667c8dd5ff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:56:04 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-747e621d-adff-4fb2-b8fb-ea6ac1522258 tempest-VolumesNegativeTest-1210062673 None] Created volume successfully. Jun 24 09:56:04 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-46f73e0f-b68a-4d71-9dd6-6386ae17ff4d tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.849s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:04 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-46f73e0f-b68a-4d71-9dd6-6386ae17ff4d tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:56:04 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-46f73e0f-b68a-4d71-9dd6-6386ae17ff4d tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Retype volume completed successfully. Jun 24 09:56:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8938b9f1-a20b-4403-b25c-2f4d4e3da931 tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Acquiring lock "cinder-32f73f88-556a-4760-843c-be1f805650bc-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:56:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8938b9f1-a20b-4403-b25c-2f4d4e3da931 tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Lock "cinder-32f73f88-556a-4760-843c-be1f805650bc-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:56:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8938b9f1-a20b-4403-b25c-2f4d4e3da931 tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Acquiring lock "cinder-quobyte-32f73f88-556a-4760-843c-be1f805650bc" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:56:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8938b9f1-a20b-4403-b25c-2f4d4e3da931 tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Lock "cinder-quobyte-32f73f88-556a-4760-843c-be1f805650bc" acquired by "delete_volume" :: waited 0.021s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:56:05 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3482c402-29e9-4eee-b16a-e084f5c4dd7b]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:56:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8938b9f1-a20b-4403-b25c-2f4d4e3da931 tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-32f73f88-556a-4760-843c-be1f805650bc {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:05 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-32f73f88-556a-4760-843c-be1f805650bc Jun 24 09:56:05 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:06 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8938b9f1-a20b-4403-b25c-2f4d4e3da931 tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-32f73f88-556a-4760-843c-be1f805650bc" returned: 0 in 0.843s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8938b9f1-a20b-4403-b25c-2f4d4e3da931 tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-32f73f88-556a-4760-843c-be1f805650bc {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:06 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-32f73f88-556a-4760-843c-be1f805650bc Jun 24 09:56:06 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:07 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8938b9f1-a20b-4403-b25c-2f4d4e3da931 tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-32f73f88-556a-4760-843c-be1f805650bc" returned: 0 in 0.760s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:07 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8938b9f1-a20b-4403-b25c-2f4d4e3da931 tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Lock "cinder-quobyte-32f73f88-556a-4760-843c-be1f805650bc" released by "delete_volume" :: held 1.675s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:56:07 devstack cinder-volume[93447]: WARNING cinder.quota [None req-8938b9f1-a20b-4403-b25c-2f4d4e3da931 tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:56:07 devstack cinder-volume[93447]: WARNING cinder.quota [None req-8938b9f1-a20b-4403-b25c-2f4d4e3da931 tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:56:07 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-8938b9f1-a20b-4403-b25c-2f4d4e3da931 tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Created reservations ['63ed9f1e-1331-421f-a56f-f55c8c1b0a28', '0b5c400d-42cf-4083-9f73-91d65a7d783e', 'e06fa85d-dc63-497e-b338-8043b4ce27f1', '260f3339-79d2-4a0c-8d8e-fbedec8e10ea'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:56:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8938b9f1-a20b-4403-b25c-2f4d4e3da931 tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:56:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8938b9f1-a20b-4403-b25c-2f4d4e3da931 tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:56:07 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8938b9f1-a20b-4403-b25c-2f4d4e3da931 tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:56:07 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8938b9f1-a20b-4403-b25c-2f4d4e3da931 tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:56:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8938b9f1-a20b-4403-b25c-2f4d4e3da931 tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:56:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8938b9f1-a20b-4403-b25c-2f4d4e3da931 tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:07 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:56:07 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-ad496647-dc9b-43d9-b4b5-9e715efb5566 req-dc546f47-c2cf-46d8-b67b-fd94ca6a3189 tempest-TestServerVolumeAttachmentScenario-322011846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:56:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-ad496647-dc9b-43d9-b4b5-9e715efb5566 req-dc546f47-c2cf-46d8-b67b-fd94ca6a3189 tempest-TestServerVolumeAttachmentScenario-322011846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:56:08 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[be21672f-e951-4f24-91d5-dac7e1975270]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:56:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-ad496647-dc9b-43d9-b4b5-9e715efb5566 req-dc546f47-c2cf-46d8-b67b-fd94ca6a3189 tempest-TestServerVolumeAttachmentScenario-322011846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-882f8953-8c44-4103-a1c3-015b7bca1cc1 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:08 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8938b9f1-a20b-4403-b25c-2f4d4e3da931 tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.924s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:08 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-8938b9f1-a20b-4403-b25c-2f4d4e3da931 tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:56:08 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-8938b9f1-a20b-4403-b25c-2f4d4e3da931 tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Deleted volume successfully. Jun 24 09:56:08 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-882f8953-8c44-4103-a1c3-015b7bca1cc1 Jun 24 09:56:08 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:08 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8938b9f1-a20b-4403-b25c-2f4d4e3da931 tempest-VolumeRetypeWithoutMigrationTest-1525988250 None] Lock "cinder-32f73f88-556a-4760-843c-be1f805650bc-delete_volume" released by "delete_volume" :: held 2.857s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:56:09 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-ad496647-dc9b-43d9-b4b5-9e715efb5566 req-dc546f47-c2cf-46d8-b67b-fd94ca6a3189 tempest-TestServerVolumeAttachmentScenario-322011846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-882f8953-8c44-4103-a1c3-015b7bca1cc1" returned: 0 in 0.899s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-ad496647-dc9b-43d9-b4b5-9e715efb5566 req-dc546f47-c2cf-46d8-b67b-fd94ca6a3189 tempest-TestServerVolumeAttachmentScenario-322011846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.921s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:56:09 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-ad496647-dc9b-43d9-b4b5-9e715efb5566 req-dc546f47-c2cf-46d8-b67b-fd94ca6a3189 tempest-TestServerVolumeAttachmentScenario-322011846 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb', 'name': 'volume-882f8953-8c44-4103-a1c3-015b7bca1cc1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '027485cb-5a00-4eee-a518-fb19b258ccae', 'enforce_multipath': True} {{(pid=93447) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 09:56:09 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-ad496647-dc9b-43d9-b4b5-9e715efb5566 req-dc546f47-c2cf-46d8-b67b-fd94ca6a3189 tempest-TestServerVolumeAttachmentScenario-322011846 None] attachment_update completed successfully. Jun 24 09:56:15 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:56:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Flow 'volume_create_manager' (f36a21e7-d618-45cd-970f-0d6a9aaf9899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:56:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8cafa7f-220b-4156-a03f-c7bc9a2fbfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8cafa7f-220b-4156-a03f-c7bc9a2fbfc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2047834083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f0c6f9-a465-4318-a955-77dc7cfadbee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc705aa42514be2ab2e1935d1c736cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:56:15Z,use_quota=True,user_id='eea5bfcb5aa841be80eefda1af048b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b63193-2773-4e57-be65-f9dda043b88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b63193-2773-4e57-be65-f9dda043b88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26ffe70-d63e-4fb0-8a39-cad0bfb47627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26ffe70-d63e-4fb0-8a39-cad0bfb47627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57f0c6f9-a465-4318-a955-77dc7cfadbee', 'volume_name': 'volume-57f0c6f9-a465-4318-a955-77dc7cfadbee', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeddf7d9-ecdd-41e3-8f4b-97ffcd2a4ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeddf7d9-ecdd-41e3-8f4b-97ffcd2a4ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bade9f5-c8c8-4b49-9146-158714648776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:15 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Volume 57f0c6f9-a465-4318-a955-77dc7cfadbee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57f0c6f9-a465-4318-a955-77dc7cfadbee', 'volume_size': 1} Jun 24 09:56:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:56:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:56:15 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2047834083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f0c6f9-a465-4318-a955-77dc7cfadbee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc705aa42514be2ab2e1935d1c736cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:56:15Z,use_quota=True,user_id='eea5bfcb5aa841be80eefda1af048b5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:56:15 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Creating volume 57f0c6f9-a465-4318-a955-77dc7cfadbee {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:56:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:56:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:56:15 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:56:15 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:56:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:56:15 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:56:15 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:56:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:15 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee 1073741824 Jun 24 09:56:15 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:16 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee 1073741824" returned: 0 in 0.909s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:16 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee Jun 24 09:56:16 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:16 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-016b2b68-d0f4-49b1-9990-bd7a05eec840 req-c454ad59-d193-474f-9c50-76cd4a228ed1 tempest-TestServerVolumeAttachmentScenario-322011846 None] Terminate volume connection completed successfully. Jun 24 09:56:16 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-016b2b68-d0f4-49b1-9990-bd7a05eec840 req-c454ad59-d193-474f-9c50-76cd4a228ed1 tempest-TestServerVolumeAttachmentScenario-322011846 None] Deleting attachment 027485cb-5a00-4eee-a518-fb19b258ccae. {{(pid=93447) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 09:56:16 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee" returned: 0 in 0.726s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:16 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:56:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:56:16 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bade9f5-c8c8-4b49-9146-158714648776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57f0c6f9-a465-4318-a955-77dc7cfadbee', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:16 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908a1305-46f2-4e9a-8dd0-a01c837105f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:16 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Volume volume-57f0c6f9-a465-4318-a955-77dc7cfadbee (57f0c6f9-a465-4318-a955-77dc7cfadbee): created successfully Jun 24 09:56:16 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908a1305-46f2-4e9a-8dd0-a01c837105f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:16 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Flow 'volume_create_manager' (f36a21e7-d618-45cd-970f-0d6a9aaf9899) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:56:16 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-28589376-ce24-4ff3-9ff3-f1953fcf5f37 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Created volume successfully. Jun 24 09:56:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1d866dc0-70de-44e0-bc49-ffe6b466f885 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:56:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1d866dc0-70de-44e0-bc49-ffe6b466f885 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:56:17 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-1d866dc0-70de-44e0-bc49-ffe6b466f885 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Creating offline snapshot b7ebdb13-adb5-426d-8ba2-f6178d16b0b8 of volume 57f0c6f9-a465-4318-a955-77dc7cfadbee {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 09:56:17 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d9258a-8db9-4a1a-8a51-6d182fdc0acf]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:56:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1d866dc0-70de-44e0-bc49-ffe6b466f885 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:17 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee Jun 24 09:56:17 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:18 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1d866dc0-70de-44e0-bc49-ffe6b466f885 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee" returned: 0 in 0.992s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1d866dc0-70de-44e0-bc49-ffe6b466f885 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.b7ebdb13-adb5-426d-8ba2-f6178d16b0b8 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:18 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.b7ebdb13-adb5-426d-8ba2-f6178d16b0b8 1G Jun 24 09:56:18 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:19 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1d866dc0-70de-44e0-bc49-ffe6b466f885 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.b7ebdb13-adb5-426d-8ba2-f6178d16b0b8 1G" returned: 0 in 0.904s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1d866dc0-70de-44e0-bc49-ffe6b466f885 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57f0c6f9-a465-4318-a955-77dc7cfadbee -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.b7ebdb13-adb5-426d-8ba2-f6178d16b0b8 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:19 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57f0c6f9-a465-4318-a955-77dc7cfadbee -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.b7ebdb13-adb5-426d-8ba2-f6178d16b0b8 Jun 24 09:56:19 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:20 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-910cc544-0652-4772-859c-72944596e51e req-39fe6f43-4fdb-4d7e-8343-dfdafb0be1b2 tempest-TestServerVolumeAttachmentScenario-322011846 None] Terminate volume connection completed successfully. Jun 24 09:56:20 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-910cc544-0652-4772-859c-72944596e51e req-39fe6f43-4fdb-4d7e-8343-dfdafb0be1b2 tempest-TestServerVolumeAttachmentScenario-322011846 None] Deleting attachment 68ede30c-d344-4767-bbe1-cbc7bfef8b03. {{(pid=93447) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 09:56:20 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1d866dc0-70de-44e0-bc49-ffe6b466f885 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57f0c6f9-a465-4318-a955-77dc7cfadbee -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.b7ebdb13-adb5-426d-8ba2-f6178d16b0b8" returned: 0 in 1.088s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:20 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-1d866dc0-70de-44e0-bc49-ffe6b466f885 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.b7ebdb13-adb5-426d-8ba2-f6178d16b0b8 is being set with open permissions: ugo+rw Jun 24 09:56:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1d866dc0-70de-44e0-bc49-ffe6b466f885 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.b7ebdb13-adb5-426d-8ba2-f6178d16b0b8 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:20 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.b7ebdb13-adb5-426d-8ba2-f6178d16b0b8 Jun 24 09:56:20 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:21 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1d866dc0-70de-44e0-bc49-ffe6b466f885 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.b7ebdb13-adb5-426d-8ba2-f6178d16b0b8" returned: 0 in 1.086s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1d866dc0-70de-44e0-bc49-ffe6b466f885 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:21 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.info Jun 24 09:56:21 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:22 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1d866dc0-70de-44e0-bc49-ffe6b466f885 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.info" returned: 0 in 1.175s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:22 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-1d866dc0-70de-44e0-bc49-ffe6b466f885 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.info is being set with open permissions: ugo+rw Jun 24 09:56:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1d866dc0-70de-44e0-bc49-ffe6b466f885 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:22 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.info Jun 24 09:56:22 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:24 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1d866dc0-70de-44e0-bc49-ffe6b466f885 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.info" returned: 0 in 1.548s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1d866dc0-70de-44e0-bc49-ffe6b466f885 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.945s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:56:24 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-1d866dc0-70de-44e0-bc49-ffe6b466f885 tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Create snapshot completed successfully Jun 24 09:56:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:56:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:56:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:56:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:56:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:56:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:56:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:25 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:56:25 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:26 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-125b34b6-27a5-4f17-8a46-bbc1e0007d7a tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Acquiring lock "cinder-b7ebdb13-adb5-426d-8ba2-f6178d16b0b8-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:56:26 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-125b34b6-27a5-4f17-8a46-bbc1e0007d7a tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Lock "cinder-b7ebdb13-adb5-426d-8ba2-f6178d16b0b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:56:26 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-125b34b6-27a5-4f17-8a46-bbc1e0007d7a tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Acquiring lock "cinder-quobyte-57f0c6f9-a465-4318-a955-77dc7cfadbee" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:56:26 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.276s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:26 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:56:26 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-125b34b6-27a5-4f17-8a46-bbc1e0007d7a tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Lock "cinder-quobyte-57f0c6f9-a465-4318-a955-77dc7cfadbee" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:56:26 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-125b34b6-27a5-4f17-8a46-bbc1e0007d7a tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Acquiring lock "cinder-quobyte-b7ebdb13-adb5-426d-8ba2-f6178d16b0b8" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:56:26 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:56:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 28 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 09:56:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 09:56:26 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-125b34b6-27a5-4f17-8a46-bbc1e0007d7a tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Lock "cinder-quobyte-b7ebdb13-adb5-426d-8ba2-f6178d16b0b8" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:56:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-125b34b6-27a5-4f17-8a46-bbc1e0007d7a tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Deleting offline snapshot b7ebdb13-adb5-426d-8ba2-f6178d16b0b8 of volume 57f0c6f9-a465-4318-a955-77dc7cfadbee {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 09:56:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-125b34b6-27a5-4f17-8a46-bbc1e0007d7a tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] snapshot_file for this snap is: volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.b7ebdb13-adb5-426d-8ba2-f6178d16b0b8 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 09:56:26 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd69718-0329-42e9-866a-c7decf04500e]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:56:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-125b34b6-27a5-4f17-8a46-bbc1e0007d7a tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.b7ebdb13-adb5-426d-8ba2-f6178d16b0b8 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:26 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.b7ebdb13-adb5-426d-8ba2-f6178d16b0b8 Jun 24 09:56:26 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:27 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-125b34b6-27a5-4f17-8a46-bbc1e0007d7a tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.b7ebdb13-adb5-426d-8ba2-f6178d16b0b8" returned: 0 in 1.056s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-125b34b6-27a5-4f17-8a46-bbc1e0007d7a tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57f0c6f9-a465-4318-a955-77dc7cfadbee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:56:27 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6246c82-a1cf-4e7b-b1db-397b8d7b98fc]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:56:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-125b34b6-27a5-4f17-8a46-bbc1e0007d7a tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:27 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee Jun 24 09:56:27 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:28 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-125b34b6-27a5-4f17-8a46-bbc1e0007d7a tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee" returned: 0 in 1.045s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-125b34b6-27a5-4f17-8a46-bbc1e0007d7a tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.b7ebdb13-adb5-426d-8ba2-f6178d16b0b8 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:28 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.b7ebdb13-adb5-426d-8ba2-f6178d16b0b8 Jun 24 09:56:28 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:29 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-125b34b6-27a5-4f17-8a46-bbc1e0007d7a tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.b7ebdb13-adb5-426d-8ba2-f6178d16b0b8" returned: 0 in 0.839s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-125b34b6-27a5-4f17-8a46-bbc1e0007d7a tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.b7ebdb13-adb5-426d-8ba2-f6178d16b0b8 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:29 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.b7ebdb13-adb5-426d-8ba2-f6178d16b0b8 Jun 24 09:56:29 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:30 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-125b34b6-27a5-4f17-8a46-bbc1e0007d7a tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee.b7ebdb13-adb5-426d-8ba2-f6178d16b0b8" returned: 0 in 0.747s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:30 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-125b34b6-27a5-4f17-8a46-bbc1e0007d7a tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Lock "cinder-quobyte-b7ebdb13-adb5-426d-8ba2-f6178d16b0b8" released by "_delete_snapshot" :: held 3.820s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:56:30 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-125b34b6-27a5-4f17-8a46-bbc1e0007d7a tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Lock "cinder-quobyte-57f0c6f9-a465-4318-a955-77dc7cfadbee" released by "delete_snapshot" :: held 3.853s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:56:30 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-125b34b6-27a5-4f17-8a46-bbc1e0007d7a tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Created reservations ['8614fd5b-0c9b-4496-99ca-2d4d18933ea3', 'ae9c1ef7-bffd-4047-96a8-42a3e666ac63', 'fe3d2221-2b1e-445a-8717-406acd2fce2d', 'aebc7d8a-06a6-4b4b-9c47-fd462939dbf7'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:56:30 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-125b34b6-27a5-4f17-8a46-bbc1e0007d7a tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Delete snapshot completed successfully. Jun 24 09:56:30 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-125b34b6-27a5-4f17-8a46-bbc1e0007d7a tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Lock "cinder-b7ebdb13-adb5-426d-8ba2-f6178d16b0b8-delete_snapshot" released by "delete_snapshot" :: held 4.017s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:56:30 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8656fa60-1441-4427-9138-1448acee215e tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Acquiring lock "cinder-57f0c6f9-a465-4318-a955-77dc7cfadbee-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:56:30 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8656fa60-1441-4427-9138-1448acee215e tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Lock "cinder-57f0c6f9-a465-4318-a955-77dc7cfadbee-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:56:30 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8656fa60-1441-4427-9138-1448acee215e tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Acquiring lock "cinder-quobyte-57f0c6f9-a465-4318-a955-77dc7cfadbee" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:56:30 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8656fa60-1441-4427-9138-1448acee215e tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Lock "cinder-quobyte-57f0c6f9-a465-4318-a955-77dc7cfadbee" acquired by "delete_volume" :: waited 0.014s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:56:30 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0ac001-63a8-48fc-830f-9b0357fbbbb6]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:56:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8656fa60-1441-4427-9138-1448acee215e tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:30 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee Jun 24 09:56:30 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:31 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:56:31 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Flow 'volume_create_manager' (042ca677-1403-4ff3-9042-4abdaf7abc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:56:31 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c765feb-42c2-419d-bc44-9bbf91656bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:31 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c765feb-42c2-419d-bc44-9bbf91656bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-447594066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96581fa0-95d6-45c1-b7d1-a2e8c17093a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1fe120b9ae412db053b63f9f53a147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:56:32Z,use_quota=True,user_id='dd15b38414d342aa9cc8b15bc4023003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:31 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a18164e0-290e-4eac-b4e4-b29933f60f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:31 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a18164e0-290e-4eac-b4e4-b29933f60f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:31 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24b6566-60e7-4d06-b654-a8a9506f6cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:31 devstack cinder-volume[93447]: DEBUG cinder.image.glance [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Creating Keystone auth plugin from conf {{(pid=93447) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 09:56:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-81385440-19c5-4d48-b6a2-a62259f3afec tempest-TestServerVolumeAttachmentScenario-322011846 None] Acquiring lock "cinder-882f8953-8c44-4103-a1c3-015b7bca1cc1-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:56:31 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8656fa60-1441-4427-9138-1448acee215e tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee" returned: 0 in 1.033s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8656fa60-1441-4427-9138-1448acee215e tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-81385440-19c5-4d48-b6a2-a62259f3afec tempest-TestServerVolumeAttachmentScenario-322011846 None] Lock "cinder-882f8953-8c44-4103-a1c3-015b7bca1cc1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:56:31 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee Jun 24 09:56:31 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-81385440-19c5-4d48-b6a2-a62259f3afec tempest-TestServerVolumeAttachmentScenario-322011846 None] Acquiring lock "cinder-quobyte-882f8953-8c44-4103-a1c3-015b7bca1cc1" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:56:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-81385440-19c5-4d48-b6a2-a62259f3afec tempest-TestServerVolumeAttachmentScenario-322011846 None] Lock "cinder-quobyte-882f8953-8c44-4103-a1c3-015b7bca1cc1" acquired by "delete_volume" :: waited 0.021s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:56:31 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6ceb87-1d6f-48ff-857f-3a7df1a41872]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:56:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-81385440-19c5-4d48-b6a2-a62259f3afec tempest-TestServerVolumeAttachmentScenario-322011846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-882f8953-8c44-4103-a1c3-015b7bca1cc1 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:32 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24b6566-60e7-4d06-b654-a8a9506f6cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '96581fa0-95d6-45c1-b7d1-a2e8c17093a6', 'volume_name': 'volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6', 'volume_size': 1, 'image_id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48394558c0ae48f385c046476f3b062e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'created_at': datetime.datetime(2026, 6, 24, 7, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 7, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:32 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65230696-5f47-448c-a288-00ce5df7a170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:32 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65230696-5f47-448c-a288-00ce5df7a170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:32 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c52a21-bdb9-4542-a76f-ebded229edf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:32 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Volume 96581fa0-95d6-45c1-b7d1-a2e8c17093a6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6', 'volume_size': 1, 'image_id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48394558c0ae48f385c046476f3b062e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'created_at': datetime.datetime(2026, 6, 24, 7, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 7, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 24 09:56:32 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Trying to clone 96581fa0-95d6-45c1-b7d1-a2e8c17093a6 from image cd371dd7-fca0-4345-9276-7b2a9b23d2c0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'metadata': {}}]). {{(pid=93447) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 09:56:32 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-882f8953-8c44-4103-a1c3-015b7bca1cc1 Jun 24 09:56:32 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:32 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_mmj4lcmqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 09:56:32 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Image download 20.69 MB at 20.69 MB/s Jun 24 09:56:32 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5e4192-9a84-4ee3-b84a-2ccf37d6d372]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:56:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_mmj4lcmqdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:32 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_mmj4lcmqdevstack@QuobyteHD Jun 24 09:56:32 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:32 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8656fa60-1441-4427-9138-1448acee215e tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-57f0c6f9-a465-4318-a955-77dc7cfadbee" returned: 0 in 0.820s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:32 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8656fa60-1441-4427-9138-1448acee215e tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Lock "cinder-quobyte-57f0c6f9-a465-4318-a955-77dc7cfadbee" released by "delete_volume" :: held 1.927s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:56:32 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-8656fa60-1441-4427-9138-1448acee215e tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Created reservations ['5ecb43c7-c5f5-42b7-be42-ceef809fc66b', '8d1e6731-fd30-4aa6-909f-323915688a27', '6d754330-8276-4954-8e67-b7c6a4ffb56e', '45bf1a0e-99d5-417c-a83a-04c21c72a72a'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:56:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8656fa60-1441-4427-9138-1448acee215e tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:56:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8656fa60-1441-4427-9138-1448acee215e tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:56:32 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8656fa60-1441-4427-9138-1448acee215e tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:56:32 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8656fa60-1441-4427-9138-1448acee215e tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:56:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8656fa60-1441-4427-9138-1448acee215e tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:56:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8656fa60-1441-4427-9138-1448acee215e tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:32 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:56:32 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:32 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-81385440-19c5-4d48-b6a2-a62259f3afec tempest-TestServerVolumeAttachmentScenario-322011846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-882f8953-8c44-4103-a1c3-015b7bca1cc1" returned: 0 in 0.982s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-81385440-19c5-4d48-b6a2-a62259f3afec tempest-TestServerVolumeAttachmentScenario-322011846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-882f8953-8c44-4103-a1c3-015b7bca1cc1 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:32 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-882f8953-8c44-4103-a1c3-015b7bca1cc1 Jun 24 09:56:32 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:33 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_mmj4lcmqdevstack@QuobyteHD" returned: 0 in 1.015s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:33 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Temporary image cd371dd7-fca0-4345-9276-7b2a9b23d2c0 is fetched for user dd15b38414d342aa9cc8b15bc4023003. {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 09:56:33 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab7e70e-ed85-4f9a-b8fe-18ea4ac2e630]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:56:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_mmj4lcmqdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:33 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:33 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_mmj4lcmqdevstack@QuobyteHD Jun 24 09:56:33 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8656fa60-1441-4427-9138-1448acee215e tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.974s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:33 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-8656fa60-1441-4427-9138-1448acee215e tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:56:33 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-8656fa60-1441-4427-9138-1448acee215e tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Deleted volume successfully. Jun 24 09:56:33 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8656fa60-1441-4427-9138-1448acee215e tempest-VolumeSnapshotQuotasNegativeTestJSON-2041066622 None] Lock "cinder-57f0c6f9-a465-4318-a955-77dc7cfadbee-delete_volume" released by "delete_volume" :: held 3.160s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:56:33 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-81385440-19c5-4d48-b6a2-a62259f3afec tempest-TestServerVolumeAttachmentScenario-322011846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-882f8953-8c44-4103-a1c3-015b7bca1cc1" returned: 0 in 0.929s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:33 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-81385440-19c5-4d48-b6a2-a62259f3afec tempest-TestServerVolumeAttachmentScenario-322011846 None] Lock "cinder-quobyte-882f8953-8c44-4103-a1c3-015b7bca1cc1" released by "delete_volume" :: held 1.966s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:56:33 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-81385440-19c5-4d48-b6a2-a62259f3afec tempest-TestServerVolumeAttachmentScenario-322011846 None] Created reservations ['b79a1a4e-4433-46b5-985d-3dce2c753da8', '6d654d90-79b9-4833-bc48-a1eea53a2586', '3e5bb143-ba4e-4199-b016-ff72e0400f22', '60d080d2-ef2b-432a-aa9e-6d868150fd47'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:56:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-81385440-19c5-4d48-b6a2-a62259f3afec tempest-TestServerVolumeAttachmentScenario-322011846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:56:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-81385440-19c5-4d48-b6a2-a62259f3afec tempest-TestServerVolumeAttachmentScenario-322011846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:56:34 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-81385440-19c5-4d48-b6a2-a62259f3afec tempest-TestServerVolumeAttachmentScenario-322011846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:56:34 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-81385440-19c5-4d48-b6a2-a62259f3afec tempest-TestServerVolumeAttachmentScenario-322011846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:56:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-81385440-19c5-4d48-b6a2-a62259f3afec tempest-TestServerVolumeAttachmentScenario-322011846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:56:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-81385440-19c5-4d48-b6a2-a62259f3afec tempest-TestServerVolumeAttachmentScenario-322011846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:34 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:56:34 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:34 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8d6be904-6823-4ed8-b8df-9efd2a7ba2fb tempest-TestServerVolumeAttachmentScenario-322011846 None] Acquiring lock "cinder-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:56:34 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8d6be904-6823-4ed8-b8df-9efd2a7ba2fb tempest-TestServerVolumeAttachmentScenario-322011846 None] Lock "cinder-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:56:34 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8d6be904-6823-4ed8-b8df-9efd2a7ba2fb tempest-TestServerVolumeAttachmentScenario-322011846 None] Acquiring lock "cinder-quobyte-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:56:34 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8d6be904-6823-4ed8-b8df-9efd2a7ba2fb tempest-TestServerVolumeAttachmentScenario-322011846 None] Lock "cinder-quobyte-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706" acquired by "delete_volume" :: waited 0.029s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:56:34 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed2527a-0acf-4134-bcd6-d39de3ab7a48]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:56:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8d6be904-6823-4ed8-b8df-9efd2a7ba2fb tempest-TestServerVolumeAttachmentScenario-322011846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:34 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706 Jun 24 09:56:34 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:34 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_mmj4lcmqdevstack@QuobyteHD" returned: 0 in 0.982s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:56:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:56:34 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-447594066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96581fa0-95d6-45c1-b7d1-a2e8c17093a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1fe120b9ae412db053b63f9f53a147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:56:32Z,use_quota=True,user_id='dd15b38414d342aa9cc8b15bc4023003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:56:34 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Creating volume 96581fa0-95d6-45c1-b7d1-a2e8c17093a6 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:56:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:56:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:56:34 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:56:34 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:56:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:56:34 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:56:34 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:56:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:34 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6 1073741824 Jun 24 09:56:34 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:35 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-81385440-19c5-4d48-b6a2-a62259f3afec tempest-TestServerVolumeAttachmentScenario-322011846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.087s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:35 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-81385440-19c5-4d48-b6a2-a62259f3afec tempest-TestServerVolumeAttachmentScenario-322011846 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:56:35 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-81385440-19c5-4d48-b6a2-a62259f3afec tempest-TestServerVolumeAttachmentScenario-322011846 None] Deleted volume successfully. Jun 24 09:56:35 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-81385440-19c5-4d48-b6a2-a62259f3afec tempest-TestServerVolumeAttachmentScenario-322011846 None] Lock "cinder-882f8953-8c44-4103-a1c3-015b7bca1cc1-delete_volume" released by "delete_volume" :: held 3.388s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:56:35 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8d6be904-6823-4ed8-b8df-9efd2a7ba2fb tempest-TestServerVolumeAttachmentScenario-322011846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706" returned: 0 in 1.269s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8d6be904-6823-4ed8-b8df-9efd2a7ba2fb tempest-TestServerVolumeAttachmentScenario-322011846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:35 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706 Jun 24 09:56:35 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:35 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6 1073741824" returned: 0 in 1.297s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:36 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6 Jun 24 09:56:36 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:36 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8d6be904-6823-4ed8-b8df-9efd2a7ba2fb tempest-TestServerVolumeAttachmentScenario-322011846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706" returned: 0 in 1.030s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8d6be904-6823-4ed8-b8df-9efd2a7ba2fb tempest-TestServerVolumeAttachmentScenario-322011846 None] Lock "cinder-quobyte-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706" released by "delete_volume" :: held 2.352s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:56:36 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-8d6be904-6823-4ed8-b8df-9efd2a7ba2fb tempest-TestServerVolumeAttachmentScenario-322011846 None] Created reservations ['5001ce49-768c-4667-830d-d88eff8544e7', 'cbbf9f15-b4fa-4cd9-99a7-39f63f148150', '5c611494-4506-474f-a21f-f0ec1861ef95', 'd1eaf5d7-0c74-4b3e-87b2-a05bd2e55c7c'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:56:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8d6be904-6823-4ed8-b8df-9efd2a7ba2fb tempest-TestServerVolumeAttachmentScenario-322011846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:56:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8d6be904-6823-4ed8-b8df-9efd2a7ba2fb tempest-TestServerVolumeAttachmentScenario-322011846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:56:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8d6be904-6823-4ed8-b8df-9efd2a7ba2fb tempest-TestServerVolumeAttachmentScenario-322011846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:56:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8d6be904-6823-4ed8-b8df-9efd2a7ba2fb tempest-TestServerVolumeAttachmentScenario-322011846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:56:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8d6be904-6823-4ed8-b8df-9efd2a7ba2fb tempest-TestServerVolumeAttachmentScenario-322011846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:56:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8d6be904-6823-4ed8-b8df-9efd2a7ba2fb tempest-TestServerVolumeAttachmentScenario-322011846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:36 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6" returned: 0 in 0.922s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] <== create_volume: return (2283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:56:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.289s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:56:36 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:56:36 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:36 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Attempting download of cd371dd7-fca0-4345-9276-7b2a9b23d2c0 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'metadata': {}}])) to volume 96581fa0-95d6-45c1-b7d1-a2e8c17093a6. {{(pid=93447) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 09:56:37 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0411cc6-12a2-4df2-82a2-9594cfcbf3df]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:56:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_g0560tkw {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:37 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_g0560tkw Jun 24 09:56:37 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:37 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8d6be904-6823-4ed8-b8df-9efd2a7ba2fb tempest-TestServerVolumeAttachmentScenario-322011846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.847s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:37 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-8d6be904-6823-4ed8-b8df-9efd2a7ba2fb tempest-TestServerVolumeAttachmentScenario-322011846 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:56:37 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-8d6be904-6823-4ed8-b8df-9efd2a7ba2fb tempest-TestServerVolumeAttachmentScenario-322011846 None] Deleted volume successfully. Jun 24 09:56:37 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8d6be904-6823-4ed8-b8df-9efd2a7ba2fb tempest-TestServerVolumeAttachmentScenario-322011846 None] Lock "cinder-ce56f3e6-1d9a-46ce-8b59-41dd01a5e706-delete_volume" released by "delete_volume" :: held 3.577s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:56:38 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_g0560tkw" returned: 0 in 1.014s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_g0560tkw {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:38 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_g0560tkw Jun 24 09:56:38 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:39 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_g0560tkw" returned: 1 in 0.998s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_g0560tkw' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 09:56:39 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7681886e-1ddb-49ff-9c76-9b8aac87827f]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:56:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_mmj4lcmqdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:39 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_mmj4lcmqdevstack@QuobyteHD Jun 24 09:56:39 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:40 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_mmj4lcmqdevstack@QuobyteHD" returned: 0 in 1.027s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:40 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] cd371dd7-fca0-4345-9276-7b2a9b23d2c0 was qcow2, converting to raw {{(pid=93447) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 09:56:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_mmj4lcmqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:40 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_mmj4lcmqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6 Jun 24 09:56:40 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f1b05e57-b461-4d2c-abad-20e9a550de54 tempest-VolumesNegativeTest-1210062673 None] Acquiring lock "cinder-36a974c6-9810-4336-b24a-6a3f83dea779-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:56:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f1b05e57-b461-4d2c-abad-20e9a550de54 tempest-VolumesNegativeTest-1210062673 None] Lock "cinder-36a974c6-9810-4336-b24a-6a3f83dea779-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:56:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f1b05e57-b461-4d2c-abad-20e9a550de54 tempest-VolumesNegativeTest-1210062673 None] Acquiring lock "cinder-quobyte-36a974c6-9810-4336-b24a-6a3f83dea779" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:56:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f1b05e57-b461-4d2c-abad-20e9a550de54 tempest-VolumesNegativeTest-1210062673 None] Lock "cinder-quobyte-36a974c6-9810-4336-b24a-6a3f83dea779" acquired by "delete_volume" :: waited 0.023s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:56:41 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fb6882-c640-4941-8b51-ee29d1e6edb0]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:56:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f1b05e57-b461-4d2c-abad-20e9a550de54 tempest-VolumesNegativeTest-1210062673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-36a974c6-9810-4336-b24a-6a3f83dea779 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:41 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-36a974c6-9810-4336-b24a-6a3f83dea779 Jun 24 09:56:42 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:42 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_mmj4lcmqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6" returned: 0 in 2.785s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:42 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_mmj4lcmqdevstack@QuobyteHD, size 112.00 MB, duration 2.79 sec, destination /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6 {{(pid=93447) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 09:56:42 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Converted 112.00 MB image at 40.19 MB/s Jun 24 09:56:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:42 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6 1G Jun 24 09:56:42 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:42 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f1b05e57-b461-4d2c-abad-20e9a550de54 tempest-VolumesNegativeTest-1210062673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-36a974c6-9810-4336-b24a-6a3f83dea779" returned: 0 in 1.109s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f1b05e57-b461-4d2c-abad-20e9a550de54 tempest-VolumesNegativeTest-1210062673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-36a974c6-9810-4336-b24a-6a3f83dea779 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:43 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-36a974c6-9810-4336-b24a-6a3f83dea779 Jun 24 09:56:43 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:43 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f1b05e57-b461-4d2c-abad-20e9a550de54 tempest-VolumesNegativeTest-1210062673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-36a974c6-9810-4336-b24a-6a3f83dea779" returned: 0 in 0.810s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:43 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6 1G" returned: 0 in 0.930s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f1b05e57-b461-4d2c-abad-20e9a550de54 tempest-VolumesNegativeTest-1210062673 None] Lock "cinder-quobyte-36a974c6-9810-4336-b24a-6a3f83dea779" released by "delete_volume" :: held 1.995s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:56:43 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[de384c1e-aebb-45ba-ac5e-c220d81034fd]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:56:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:43 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-f1b05e57-b461-4d2c-abad-20e9a550de54 tempest-VolumesNegativeTest-1210062673 None] Created reservations ['a84d92eb-b157-4ee0-b60a-b542dcf8812b', '90a58211-d98d-4f5b-8a60-4ad07e0025be', 'b5687500-b60b-4867-9869-cabffbfcbe72', 'da621144-2b53-4c03-9bf1-4e1737b93bd3'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:56:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f1b05e57-b461-4d2c-abad-20e9a550de54 tempest-VolumesNegativeTest-1210062673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:56:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f1b05e57-b461-4d2c-abad-20e9a550de54 tempest-VolumesNegativeTest-1210062673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:56:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f1b05e57-b461-4d2c-abad-20e9a550de54 tempest-VolumesNegativeTest-1210062673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:56:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f1b05e57-b461-4d2c-abad-20e9a550de54 tempest-VolumesNegativeTest-1210062673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:56:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f1b05e57-b461-4d2c-abad-20e9a550de54 tempest-VolumesNegativeTest-1210062673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:56:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f1b05e57-b461-4d2c-abad-20e9a550de54 tempest-VolumesNegativeTest-1210062673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:44 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6 Jun 24 09:56:44 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:44 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:56:44 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:44 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6" returned: 0 in 0.902s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:44 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f1b05e57-b461-4d2c-abad-20e9a550de54 tempest-VolumesNegativeTest-1210062673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.849s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:44 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-f1b05e57-b461-4d2c-abad-20e9a550de54 tempest-VolumesNegativeTest-1210062673 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:56:44 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-f1b05e57-b461-4d2c-abad-20e9a550de54 tempest-VolumesNegativeTest-1210062673 None] Deleted volume successfully. Jun 24 09:56:44 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f1b05e57-b461-4d2c-abad-20e9a550de54 tempest-VolumesNegativeTest-1210062673 None] Lock "cinder-36a974c6-9810-4336-b24a-6a3f83dea779-delete_volume" released by "delete_volume" :: held 3.236s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:56:45 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6 Jun 24 09:56:45 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:45 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6" returned: 1 in 1.043s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 09:56:45 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Downloaded image cd371dd7-fca0-4345-9276-7b2a9b23d2c0 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'metadata': {}}])) to volume 96581fa0-95d6-45c1-b7d1-a2e8c17093a6 successfully. {{(pid=93447) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 09:56:45 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Temporary image cd371dd7-fca0-4345-9276-7b2a9b23d2c0 for user dd15b38414d342aa9cc8b15bc4023003 is deleted. {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 09:56:45 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Marking volume 96581fa0-95d6-45c1-b7d1-a2e8c17093a6 as bootable. {{(pid=93447) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 09:56:45 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Copying metadata from image cd371dd7-fca0-4345-9276-7b2a9b23d2c0 to 96581fa0-95d6-45c1-b7d1-a2e8c17093a6. {{(pid=93447) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 09:56:45 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Creating volume glance metadata for volume 96581fa0-95d6-45c1-b7d1-a2e8c17093a6 backed by image cd371dd7-fca0-4345-9276-7b2a9b23d2c0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93447) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 09:56:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68c52a21-bdb9-4542-a76f-ebded229edf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6', 'volume_size': 1, 'image_id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48394558c0ae48f385c046476f3b062e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'created_at': datetime.datetime(2026, 6, 24, 7, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 7, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67045c6a-3353-4f4f-ab1d-bc918546bcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:46 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Volume volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6 (96581fa0-95d6-45c1-b7d1-a2e8c17093a6): created successfully Jun 24 09:56:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67045c6a-3353-4f4f-ab1d-bc918546bcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Flow 'volume_create_manager' (042ca677-1403-4ff3-9042-4abdaf7abc77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:56:46 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-7cca9f9e-8703-4edd-98a0-a0b747add36b tempest-VolumesImageMetadata-603636687 None] Created volume successfully. Jun 24 09:56:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e571a4e0-6280-45d3-99ff-caa87559357f tempest-VolumesImageMetadata-603636687 None] Acquiring lock "cinder-96581fa0-95d6-45c1-b7d1-a2e8c17093a6-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:56:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e571a4e0-6280-45d3-99ff-caa87559357f tempest-VolumesImageMetadata-603636687 None] Lock "cinder-96581fa0-95d6-45c1-b7d1-a2e8c17093a6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:56:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e571a4e0-6280-45d3-99ff-caa87559357f tempest-VolumesImageMetadata-603636687 None] Acquiring lock "cinder-quobyte-96581fa0-95d6-45c1-b7d1-a2e8c17093a6" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:56:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e571a4e0-6280-45d3-99ff-caa87559357f tempest-VolumesImageMetadata-603636687 None] Lock "cinder-quobyte-96581fa0-95d6-45c1-b7d1-a2e8c17093a6" acquired by "delete_volume" :: waited 0.028s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:56:47 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f3138b-bd50-413a-9aed-04315b6f54b8]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:56:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e571a4e0-6280-45d3-99ff-caa87559357f tempest-VolumesImageMetadata-603636687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:47 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6 Jun 24 09:56:47 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:48 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e571a4e0-6280-45d3-99ff-caa87559357f tempest-VolumesImageMetadata-603636687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6" returned: 0 in 1.059s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e571a4e0-6280-45d3-99ff-caa87559357f tempest-VolumesImageMetadata-603636687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:48 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6 Jun 24 09:56:48 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:49 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e571a4e0-6280-45d3-99ff-caa87559357f tempest-VolumesImageMetadata-603636687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6" returned: 1 in 0.985s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e571a4e0-6280-45d3-99ff-caa87559357f tempest-VolumesImageMetadata-603636687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 09:56:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e571a4e0-6280-45d3-99ff-caa87559357f tempest-VolumesImageMetadata-603636687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:49 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6 Jun 24 09:56:49 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:49 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:56:49 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Flow 'volume_create_manager' (1b28f8be-7dbd-4768-9bc7-9af763265acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:56:49 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80c3082-56e3-4ce3-bc91-913d3037b546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80c3082-56e3-4ce3-bc91-913d3037b546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1283135316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=799a7990-52f8-4129-ad6c-6977d991a074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3498a11f139643c0be490bedc59065ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:56:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:56:50Z,use_quota=True,user_id='8c503486799e4e69bf25bb04220adcc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c59340-dda1-45e5-a997-234e0aa72c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c59340-dda1-45e5-a997-234e0aa72c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cbc0389-8a98-41b7-9a46-6756bf2b52c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cbc0389-8a98-41b7-9a46-6756bf2b52c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '799a7990-52f8-4129-ad6c-6977d991a074', 'volume_name': 'volume-799a7990-52f8-4129-ad6c-6977d991a074', 'volume_size': 2}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28c14e7-80c3-48c6-b66f-5a21d97eec84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28c14e7-80c3-48c6-b66f-5a21d97eec84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c4bb12-188f-476f-8ef5-1bfea0703785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:50 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Volume 799a7990-52f8-4129-ad6c-6977d991a074: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-799a7990-52f8-4129-ad6c-6977d991a074', 'volume_size': 2} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1283135316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=799a7990-52f8-4129-ad6c-6977d991a074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3498a11f139643c0be490bedc59065ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:56:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:56:50Z,use_quota=True,user_id='8c503486799e4e69bf25bb04220adcc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Creating volume 799a7990-52f8-4129-ad6c-6977d991a074 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:56:50 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074 2147483648 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:50 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074 2147483648 Jun 24 09:56:50 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:50 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e571a4e0-6280-45d3-99ff-caa87559357f tempest-VolumesImageMetadata-603636687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-96581fa0-95d6-45c1-b7d1-a2e8c17093a6" returned: 0 in 1.016s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e571a4e0-6280-45d3-99ff-caa87559357f tempest-VolumesImageMetadata-603636687 None] Lock "cinder-quobyte-96581fa0-95d6-45c1-b7d1-a2e8c17093a6" released by "delete_volume" :: held 3.154s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-e571a4e0-6280-45d3-99ff-caa87559357f tempest-VolumesImageMetadata-603636687 None] Created reservations ['9a6932ee-ab91-490d-a64e-b3bb9bbc0782', 'cc07985e-2001-4f11-b78b-087d58dd2730', '0798a5fd-a1c9-43e5-b9ed-d4975b6f383a', '0bd54993-a5fd-432a-b41f-7ffaa93bf95a'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e571a4e0-6280-45d3-99ff-caa87559357f tempest-VolumesImageMetadata-603636687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e571a4e0-6280-45d3-99ff-caa87559357f tempest-VolumesImageMetadata-603636687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-e571a4e0-6280-45d3-99ff-caa87559357f tempest-VolumesImageMetadata-603636687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-e571a4e0-6280-45d3-99ff-caa87559357f tempest-VolumesImageMetadata-603636687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e571a4e0-6280-45d3-99ff-caa87559357f tempest-VolumesImageMetadata-603636687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:56:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e571a4e0-6280-45d3-99ff-caa87559357f tempest-VolumesImageMetadata-603636687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:50 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:56:50 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:51 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074 2147483648" returned: 0 in 1.262s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:51 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074 Jun 24 09:56:51 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:52 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e571a4e0-6280-45d3-99ff-caa87559357f tempest-VolumesImageMetadata-603636687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.215s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:52 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-e571a4e0-6280-45d3-99ff-caa87559357f tempest-VolumesImageMetadata-603636687 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:56:52 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-e571a4e0-6280-45d3-99ff-caa87559357f tempest-VolumesImageMetadata-603636687 None] Deleted volume successfully. Jun 24 09:56:52 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e571a4e0-6280-45d3-99ff-caa87559357f tempest-VolumesImageMetadata-603636687 None] Lock "cinder-96581fa0-95d6-45c1-b7d1-a2e8c17093a6-delete_volume" released by "delete_volume" :: held 4.713s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:56:52 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074" returned: 0 in 0.905s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:52 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] <== create_volume: return (2250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:56:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.256s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:56:52 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c4bb12-188f-476f-8ef5-1bfea0703785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-799a7990-52f8-4129-ad6c-6977d991a074', 'volume_size': 2}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:52 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e33438-a250-4263-8414-376251bebb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:52 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Volume volume-799a7990-52f8-4129-ad6c-6977d991a074 (799a7990-52f8-4129-ad6c-6977d991a074): created successfully Jun 24 09:56:52 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e33438-a250-4263-8414-376251bebb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:52 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Flow 'volume_create_manager' (1b28f8be-7dbd-4768-9bc7-9af763265acd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:56:52 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-49093cdd-6990-4337-9818-9b8040e58f7a tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Created volume successfully. Jun 24 09:56:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-27f742d1-e402-4041-8254-cb89d19d5327 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:56:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-27f742d1-e402-4041-8254-cb89d19d5327 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:56:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-27f742d1-e402-4041-8254-cb89d19d5327 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Creating offline snapshot 810617d9-7474-425c-867c-297d986df532 of volume 799a7990-52f8-4129-ad6c-6977d991a074 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 09:56:53 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[16da8b3b-a5cc-41f4-b081-035311ebbcfa]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:56:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27f742d1-e402-4041-8254-cb89d19d5327 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:53 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074 Jun 24 09:56:53 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:54 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27f742d1-e402-4041-8254-cb89d19d5327 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074" returned: 0 in 1.166s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27f742d1-e402-4041-8254-cb89d19d5327 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.810617d9-7474-425c-867c-297d986df532 2G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:54 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.810617d9-7474-425c-867c-297d986df532 2G Jun 24 09:56:54 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:56 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27f742d1-e402-4041-8254-cb89d19d5327 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.810617d9-7474-425c-867c-297d986df532 2G" returned: 0 in 1.238s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27f742d1-e402-4041-8254-cb89d19d5327 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-799a7990-52f8-4129-ad6c-6977d991a074 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.810617d9-7474-425c-867c-297d986df532 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:56 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-799a7990-52f8-4129-ad6c-6977d991a074 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.810617d9-7474-425c-867c-297d986df532 Jun 24 09:56:56 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:56 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27f742d1-e402-4041-8254-cb89d19d5327 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-799a7990-52f8-4129-ad6c-6977d991a074 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.810617d9-7474-425c-867c-297d986df532" returned: 0 in 0.846s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:56 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-27f742d1-e402-4041-8254-cb89d19d5327 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.810617d9-7474-425c-867c-297d986df532 is being set with open permissions: ugo+rw Jun 24 09:56:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27f742d1-e402-4041-8254-cb89d19d5327 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.810617d9-7474-425c-867c-297d986df532 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:56 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.810617d9-7474-425c-867c-297d986df532 Jun 24 09:56:56 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:57 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27f742d1-e402-4041-8254-cb89d19d5327 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.810617d9-7474-425c-867c-297d986df532" returned: 0 in 0.894s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27f742d1-e402-4041-8254-cb89d19d5327 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:57 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.info Jun 24 09:56:57 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:57 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:56:58 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Flow 'volume_create_manager' (c475ef81-29d1-4c54-b83f-4d2a93cc9b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:56:58 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cfb6d24-9c05-4525-814a-f1c799e70074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:58 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cfb6d24-9c05-4525-814a-f1c799e70074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-189684117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee856702-cb32-419a-aecb-0e957ec19e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8acebcef3fa4d69b83dfe78216038db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:56:58Z,use_quota=True,user_id='8ad994e4ddd1443e87331f91ad65b3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:58 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e2ce91-3299-45fd-ba43-bc95c5a7ef4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:58 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e2ce91-3299-45fd-ba43-bc95c5a7ef4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:58 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9bb09a-262e-474f-ac9b-e663eb1e340f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:58 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9bb09a-262e-474f-ac9b-e663eb1e340f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee856702-cb32-419a-aecb-0e957ec19e92', 'volume_name': 'volume-ee856702-cb32-419a-aecb-0e957ec19e92', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:58 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5de773-74c5-4188-a8b2-e254b675000d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:58 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5de773-74c5-4188-a8b2-e254b675000d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:56:58 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1907a57b-5cf1-4a99-9a8a-5e68a11d86dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:56:58 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Volume ee856702-cb32-419a-aecb-0e957ec19e92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee856702-cb32-419a-aecb-0e957ec19e92', 'volume_size': 1} Jun 24 09:56:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:56:58 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27f742d1-e402-4041-8254-cb89d19d5327 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.info" returned: 0 in 0.757s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:58 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-27f742d1-e402-4041-8254-cb89d19d5327 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.info is being set with open permissions: ugo+rw Jun 24 09:56:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27f742d1-e402-4041-8254-cb89d19d5327 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:58 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.info Jun 24 09:56:58 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:56:59 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Jun 24 09:56:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27f742d1-e402-4041-8254-cb89d19d5327 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.info" returned: 0 in 0.798s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:56:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-27f742d1-e402-4041-8254-cb89d19d5327 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.875s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:56:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.389s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:56:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-189684117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee856702-cb32-419a-aecb-0e957ec19e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8acebcef3fa4d69b83dfe78216038db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:56:58Z,use_quota=True,user_id='8ad994e4ddd1443e87331f91ad65b3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:56:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Creating volume ee856702-cb32-419a-aecb-0e957ec19e92 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:56:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:56:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:56:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:56:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:56:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:56:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:56:59 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:56:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ee856702-cb32-419a-aecb-0e957ec19e92 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:56:59 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ee856702-cb32-419a-aecb-0e957ec19e92 1073741824 Jun 24 09:56:59 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-27f742d1-e402-4041-8254-cb89d19d5327 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Create snapshot completed successfully Jun 24 09:56:59 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:00 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-622123cb-ee58-4ee9-a88f-a2756c7597be tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Acquiring lock "cinder-810617d9-7474-425c-867c-297d986df532-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:57:00 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-622123cb-ee58-4ee9-a88f-a2756c7597be tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Lock "cinder-810617d9-7474-425c-867c-297d986df532-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:57:00 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-622123cb-ee58-4ee9-a88f-a2756c7597be tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Acquiring lock "cinder-quobyte-799a7990-52f8-4129-ad6c-6977d991a074" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:57:00 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-622123cb-ee58-4ee9-a88f-a2756c7597be tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Lock "cinder-quobyte-799a7990-52f8-4129-ad6c-6977d991a074" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:57:00 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-622123cb-ee58-4ee9-a88f-a2756c7597be tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Acquiring lock "cinder-quobyte-810617d9-7474-425c-867c-297d986df532" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:57:00 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-622123cb-ee58-4ee9-a88f-a2756c7597be tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Lock "cinder-quobyte-810617d9-7474-425c-867c-297d986df532" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:57:00 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-622123cb-ee58-4ee9-a88f-a2756c7597be tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Deleting offline snapshot 810617d9-7474-425c-867c-297d986df532 of volume 799a7990-52f8-4129-ad6c-6977d991a074 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 09:57:00 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-622123cb-ee58-4ee9-a88f-a2756c7597be tempest-VolumesSnapshotNegativeTestJSON-836009470 None] snapshot_file for this snap is: volume-799a7990-52f8-4129-ad6c-6977d991a074.810617d9-7474-425c-867c-297d986df532 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 09:57:00 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e622ded-6deb-4e9c-8ffd-d9f0f1895e42]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:57:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-622123cb-ee58-4ee9-a88f-a2756c7597be tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.810617d9-7474-425c-867c-297d986df532 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:00 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.810617d9-7474-425c-867c-297d986df532 Jun 24 09:57:00 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:00 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ee856702-cb32-419a-aecb-0e957ec19e92 1073741824" returned: 0 in 1.215s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ee856702-cb32-419a-aecb-0e957ec19e92 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:00 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ee856702-cb32-419a-aecb-0e957ec19e92 Jun 24 09:57:00 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:01 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ee856702-cb32-419a-aecb-0e957ec19e92" returned: 0 in 0.755s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:01 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] <== create_volume: return (2036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:57:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.039s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:57:01 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1907a57b-5cf1-4a99-9a8a-5e68a11d86dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee856702-cb32-419a-aecb-0e957ec19e92', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:01 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc1cac3-ee5f-46a4-b316-4336bea98e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:01 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Volume volume-ee856702-cb32-419a-aecb-0e957ec19e92 (ee856702-cb32-419a-aecb-0e957ec19e92): created successfully Jun 24 09:57:01 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc1cac3-ee5f-46a4-b316-4336bea98e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:01 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Flow 'volume_create_manager' (c475ef81-29d1-4c54-b83f-4d2a93cc9b30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:57:01 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-3c1da9d1-6d86-4daf-abdc-7ee868f0a358 tempest-VolumesTransfersV355Test-1562135197 None] Created volume successfully. Jun 24 09:57:01 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-622123cb-ee58-4ee9-a88f-a2756c7597be tempest-VolumesSnapshotNegativeTestJSON-836009470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.810617d9-7474-425c-867c-297d986df532" returned: 0 in 1.367s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:01 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-622123cb-ee58-4ee9-a88f-a2756c7597be tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-799a7990-52f8-4129-ad6c-6977d991a074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:57:01 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad91172-2e29-4979-acdf-f08354823b2f]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:57:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-622123cb-ee58-4ee9-a88f-a2756c7597be tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:01 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074 Jun 24 09:57:01 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:02 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-622123cb-ee58-4ee9-a88f-a2756c7597be tempest-VolumesSnapshotNegativeTestJSON-836009470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074" returned: 0 in 1.058s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-622123cb-ee58-4ee9-a88f-a2756c7597be tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.810617d9-7474-425c-867c-297d986df532 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:02 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.810617d9-7474-425c-867c-297d986df532 Jun 24 09:57:02 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:03 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:UPDATE=76,cinder:DELETE=7,cinder:SELECT=81,cinder:INSERT=23 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:57:03 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-5eee29ca-2b4e-494f-a4ee-5790aa29c0f5 tempest-VolumesTransfersV355Test-1593250204 None] Transfer volume completed successfully. Jun 24 09:57:03 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-622123cb-ee58-4ee9-a88f-a2756c7597be tempest-VolumesSnapshotNegativeTestJSON-836009470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.810617d9-7474-425c-867c-297d986df532" returned: 0 in 1.057s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-622123cb-ee58-4ee9-a88f-a2756c7597be tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.810617d9-7474-425c-867c-297d986df532 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:03 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.810617d9-7474-425c-867c-297d986df532 Jun 24 09:57:03 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:04 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fe42a254-0350-44a0-97b2-b05540ee6ba8 tempest-VolumesTransfersV355Test-484971139 None] Acquiring lock "cinder-ee856702-cb32-419a-aecb-0e957ec19e92-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:57:04 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fe42a254-0350-44a0-97b2-b05540ee6ba8 tempest-VolumesTransfersV355Test-484971139 None] Lock "cinder-ee856702-cb32-419a-aecb-0e957ec19e92-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:57:04 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:UPDATE=83,cinder:SELECT=69,cinder:INSERT=25,cinder:DELETE=7 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:57:04 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fe42a254-0350-44a0-97b2-b05540ee6ba8 tempest-VolumesTransfersV355Test-484971139 None] Acquiring lock "cinder-quobyte-ee856702-cb32-419a-aecb-0e957ec19e92" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:57:04 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fe42a254-0350-44a0-97b2-b05540ee6ba8 tempest-VolumesTransfersV355Test-484971139 None] Lock "cinder-quobyte-ee856702-cb32-419a-aecb-0e957ec19e92" acquired by "delete_volume" :: waited 0.023s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:57:04 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f23208e-256c-49d2-bca7-a9885350b064]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:57:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fe42a254-0350-44a0-97b2-b05540ee6ba8 tempest-VolumesTransfersV355Test-484971139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ee856702-cb32-419a-aecb-0e957ec19e92 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:04 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ee856702-cb32-419a-aecb-0e957ec19e92 Jun 24 09:57:04 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-622123cb-ee58-4ee9-a88f-a2756c7597be tempest-VolumesSnapshotNegativeTestJSON-836009470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074.810617d9-7474-425c-867c-297d986df532" returned: 0 in 0.959s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:04 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:04 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-622123cb-ee58-4ee9-a88f-a2756c7597be tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Lock "cinder-quobyte-810617d9-7474-425c-867c-297d986df532" released by "_delete_snapshot" :: held 4.628s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:57:04 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-622123cb-ee58-4ee9-a88f-a2756c7597be tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Lock "cinder-quobyte-799a7990-52f8-4129-ad6c-6977d991a074" released by "delete_snapshot" :: held 4.670s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:57:05 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-622123cb-ee58-4ee9-a88f-a2756c7597be tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Created reservations ['3ee6c13f-a4fa-49f5-87fc-41ac204021ed', '5f0aa50d-9d69-4827-b56f-4dfd041babc3', '5780fda1-9fa7-4a9f-b98f-5b756cd7a6b6', 'bca4d1c2-3511-4e2e-9714-0bcc5be30ae1'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:57:05 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-622123cb-ee58-4ee9-a88f-a2756c7597be tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Delete snapshot completed successfully. Jun 24 09:57:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-622123cb-ee58-4ee9-a88f-a2756c7597be tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Lock "cinder-810617d9-7474-425c-867c-297d986df532-delete_snapshot" released by "delete_snapshot" :: held 4.861s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:57:05 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fe42a254-0350-44a0-97b2-b05540ee6ba8 tempest-VolumesTransfersV355Test-484971139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ee856702-cb32-419a-aecb-0e957ec19e92" returned: 0 in 0.998s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fe42a254-0350-44a0-97b2-b05540ee6ba8 tempest-VolumesTransfersV355Test-484971139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ee856702-cb32-419a-aecb-0e957ec19e92 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:05 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ee856702-cb32-419a-aecb-0e957ec19e92 Jun 24 09:57:05 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1fe3221d-277c-49ff-bccd-918b2b560e45 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Acquiring lock "cinder-799a7990-52f8-4129-ad6c-6977d991a074-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:57:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1fe3221d-277c-49ff-bccd-918b2b560e45 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Lock "cinder-799a7990-52f8-4129-ad6c-6977d991a074-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:57:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1fe3221d-277c-49ff-bccd-918b2b560e45 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Acquiring lock "cinder-quobyte-799a7990-52f8-4129-ad6c-6977d991a074" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:57:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1fe3221d-277c-49ff-bccd-918b2b560e45 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Lock "cinder-quobyte-799a7990-52f8-4129-ad6c-6977d991a074" acquired by "delete_volume" :: waited 0.030s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:57:05 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8d0094-faf6-42dc-b22e-7776e31248f0]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:57:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1fe3221d-277c-49ff-bccd-918b2b560e45 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:06 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074 Jun 24 09:57:06 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:06 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fe42a254-0350-44a0-97b2-b05540ee6ba8 tempest-VolumesTransfersV355Test-484971139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ee856702-cb32-419a-aecb-0e957ec19e92" returned: 0 in 0.921s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:06 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fe42a254-0350-44a0-97b2-b05540ee6ba8 tempest-VolumesTransfersV355Test-484971139 None] Lock "cinder-quobyte-ee856702-cb32-419a-aecb-0e957ec19e92" released by "delete_volume" :: held 1.983s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:57:06 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-fe42a254-0350-44a0-97b2-b05540ee6ba8 tempest-VolumesTransfersV355Test-484971139 None] Created reservations ['e94286fa-336b-4966-9d04-560d507e1fef', '7e3a4c4c-e2b3-4d8d-9d80-8c69ae61dd21', '7fa28c47-959f-4b7b-a666-477c6e932339', '31164b6b-ba14-4057-84a8-cc07b8a76835'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:57:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-fe42a254-0350-44a0-97b2-b05540ee6ba8 tempest-VolumesTransfersV355Test-484971139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:57:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-fe42a254-0350-44a0-97b2-b05540ee6ba8 tempest-VolumesTransfersV355Test-484971139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:57:06 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-fe42a254-0350-44a0-97b2-b05540ee6ba8 tempest-VolumesTransfersV355Test-484971139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:57:06 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-fe42a254-0350-44a0-97b2-b05540ee6ba8 tempest-VolumesTransfersV355Test-484971139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:57:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-fe42a254-0350-44a0-97b2-b05540ee6ba8 tempest-VolumesTransfersV355Test-484971139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:57:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fe42a254-0350-44a0-97b2-b05540ee6ba8 tempest-VolumesTransfersV355Test-484971139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:06 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:57:06 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:06 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1fe3221d-277c-49ff-bccd-918b2b560e45 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074" returned: 0 in 1.018s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1fe3221d-277c-49ff-bccd-918b2b560e45 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:07 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074 Jun 24 09:57:07 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:07 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fe42a254-0350-44a0-97b2-b05540ee6ba8 tempest-VolumesTransfersV355Test-484971139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.017s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:07 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-fe42a254-0350-44a0-97b2-b05540ee6ba8 tempest-VolumesTransfersV355Test-484971139 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:57:07 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-fe42a254-0350-44a0-97b2-b05540ee6ba8 tempest-VolumesTransfersV355Test-484971139 None] Deleted volume successfully. Jun 24 09:57:07 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fe42a254-0350-44a0-97b2-b05540ee6ba8 tempest-VolumesTransfersV355Test-484971139 None] Lock "cinder-ee856702-cb32-419a-aecb-0e957ec19e92-delete_volume" released by "delete_volume" :: held 3.488s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:57:08 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1fe3221d-277c-49ff-bccd-918b2b560e45 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-799a7990-52f8-4129-ad6c-6977d991a074" returned: 0 in 1.381s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1fe3221d-277c-49ff-bccd-918b2b560e45 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Lock "cinder-quobyte-799a7990-52f8-4129-ad6c-6977d991a074" released by "delete_volume" :: held 2.493s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-1fe3221d-277c-49ff-bccd-918b2b560e45 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Created reservations ['f0b09735-5980-4f4f-9777-b31e9cf0f553', '34cd0590-4e95-4737-b262-538e603e2bbc', 'dbeceb29-1343-49af-88e1-f1a1033e9c17', '6be42955-7ed0-492a-9ff3-859c1b8e3ce3'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1fe3221d-277c-49ff-bccd-918b2b560e45 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1fe3221d-277c-49ff-bccd-918b2b560e45 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1fe3221d-277c-49ff-bccd-918b2b560e45 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1fe3221d-277c-49ff-bccd-918b2b560e45 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1fe3221d-277c-49ff-bccd-918b2b560e45 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1fe3221d-277c-49ff-bccd-918b2b560e45 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:08 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:57:08 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Flow 'volume_create_manager' (1181c704-d359-4bbd-8fec-7300bf918998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a444bb-74af-47a9-915a-08291f0f87e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a444bb-74af-47a9-915a-08291f0f87e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1589715800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7519798-17a5-4701-9288-57bb81da1c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8acebcef3fa4d69b83dfe78216038db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:57:09Z,use_quota=True,user_id='8ad994e4ddd1443e87331f91ad65b3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e0eddd6-57e7-483c-bf39-a56297b07b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e0eddd6-57e7-483c-bf39-a56297b07b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb2b3f5-bf8a-4d0b-86ad-f82c21b85f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb2b3f5-bf8a-4d0b-86ad-f82c21b85f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7519798-17a5-4701-9288-57bb81da1c30', 'volume_name': 'volume-e7519798-17a5-4701-9288-57bb81da1c30', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71bc922f-fea3-4be4-a26b-2606deb0ba11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71bc922f-fea3-4be4-a26b-2606deb0ba11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896c0223-7412-4498-ac41-5623a7aa79f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:08 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Volume e7519798-17a5-4701-9288-57bb81da1c30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7519798-17a5-4701-9288-57bb81da1c30', 'volume_size': 1} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1589715800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7519798-17a5-4701-9288-57bb81da1c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8acebcef3fa4d69b83dfe78216038db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:57:09Z,use_quota=True,user_id='8ad994e4ddd1443e87331f91ad65b3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Creating volume e7519798-17a5-4701-9288-57bb81da1c30 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:57:08 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:57:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e7519798-17a5-4701-9288-57bb81da1c30 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:08 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e7519798-17a5-4701-9288-57bb81da1c30 1073741824 Jun 24 09:57:08 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:09 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1fe3221d-277c-49ff-bccd-918b2b560e45 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.976s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:09 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-1fe3221d-277c-49ff-bccd-918b2b560e45 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:57:09 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-1fe3221d-277c-49ff-bccd-918b2b560e45 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Deleted volume successfully. Jun 24 09:57:09 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1fe3221d-277c-49ff-bccd-918b2b560e45 tempest-VolumesSnapshotNegativeTestJSON-836009470 None] Lock "cinder-799a7990-52f8-4129-ad6c-6977d991a074-delete_volume" released by "delete_volume" :: held 3.742s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:57:10 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e7519798-17a5-4701-9288-57bb81da1c30 1073741824" returned: 0 in 1.245s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e7519798-17a5-4701-9288-57bb81da1c30 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:10 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e7519798-17a5-4701-9288-57bb81da1c30 Jun 24 09:57:10 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:11 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e7519798-17a5-4701-9288-57bb81da1c30" returned: 0 in 0.919s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:11 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] <== create_volume: return (2233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:57:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.240s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:57:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896c0223-7412-4498-ac41-5623a7aa79f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7519798-17a5-4701-9288-57bb81da1c30', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d8107f-e20a-4de6-ba3c-c0726d0b99e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:11 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Volume volume-e7519798-17a5-4701-9288-57bb81da1c30 (e7519798-17a5-4701-9288-57bb81da1c30): created successfully Jun 24 09:57:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d8107f-e20a-4de6-ba3c-c0726d0b99e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Flow 'volume_create_manager' (1181c704-d359-4bbd-8fec-7300bf918998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:57:11 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-feb2a7aa-391d-435c-a071-debece44aa5a tempest-VolumesTransfersV355Test-1562135197 None] Created volume successfully. Jun 24 09:57:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-6249a406-a5e4-48a7-92b2-7c00681261ae tempest-VolumesTransfersV355Test-484971139 None] Acquiring lock "cinder-e7519798-17a5-4701-9288-57bb81da1c30-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:57:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-6249a406-a5e4-48a7-92b2-7c00681261ae tempest-VolumesTransfersV355Test-484971139 None] Lock "cinder-e7519798-17a5-4701-9288-57bb81da1c30-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:57:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-6249a406-a5e4-48a7-92b2-7c00681261ae tempest-VolumesTransfersV355Test-484971139 None] Acquiring lock "cinder-quobyte-e7519798-17a5-4701-9288-57bb81da1c30" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:57:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-6249a406-a5e4-48a7-92b2-7c00681261ae tempest-VolumesTransfersV355Test-484971139 None] Lock "cinder-quobyte-e7519798-17a5-4701-9288-57bb81da1c30" acquired by "delete_volume" :: waited 0.022s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:57:12 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[db36e9fd-1339-45d3-9d9e-847bedefe8d6]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:57:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6249a406-a5e4-48a7-92b2-7c00681261ae tempest-VolumesTransfersV355Test-484971139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e7519798-17a5-4701-9288-57bb81da1c30 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:12 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e7519798-17a5-4701-9288-57bb81da1c30 Jun 24 09:57:12 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:13 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6249a406-a5e4-48a7-92b2-7c00681261ae tempest-VolumesTransfersV355Test-484971139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e7519798-17a5-4701-9288-57bb81da1c30" returned: 0 in 0.940s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6249a406-a5e4-48a7-92b2-7c00681261ae tempest-VolumesTransfersV355Test-484971139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e7519798-17a5-4701-9288-57bb81da1c30 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:13 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e7519798-17a5-4701-9288-57bb81da1c30 Jun 24 09:57:13 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:14 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6249a406-a5e4-48a7-92b2-7c00681261ae tempest-VolumesTransfersV355Test-484971139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e7519798-17a5-4701-9288-57bb81da1c30" returned: 0 in 0.711s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:14 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-6249a406-a5e4-48a7-92b2-7c00681261ae tempest-VolumesTransfersV355Test-484971139 None] Lock "cinder-quobyte-e7519798-17a5-4701-9288-57bb81da1c30" released by "delete_volume" :: held 1.724s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:57:14 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-6249a406-a5e4-48a7-92b2-7c00681261ae tempest-VolumesTransfersV355Test-484971139 None] Created reservations ['4dcb696d-e2d4-41d3-94e9-d3688915ea43', '47709941-3edf-4ef0-8f47-202488a22102', 'b576ea4e-45b7-460a-b883-6a2a2cdd4753', '2b203108-8298-4bb2-bad5-2190358a061c'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:57:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6249a406-a5e4-48a7-92b2-7c00681261ae tempest-VolumesTransfersV355Test-484971139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:57:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6249a406-a5e4-48a7-92b2-7c00681261ae tempest-VolumesTransfersV355Test-484971139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:57:14 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6249a406-a5e4-48a7-92b2-7c00681261ae tempest-VolumesTransfersV355Test-484971139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:57:14 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6249a406-a5e4-48a7-92b2-7c00681261ae tempest-VolumesTransfersV355Test-484971139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:57:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6249a406-a5e4-48a7-92b2-7c00681261ae tempest-VolumesTransfersV355Test-484971139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:57:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6249a406-a5e4-48a7-92b2-7c00681261ae tempest-VolumesTransfersV355Test-484971139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:14 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:57:14 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:15 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6249a406-a5e4-48a7-92b2-7c00681261ae tempest-VolumesTransfersV355Test-484971139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.181s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:15 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-6249a406-a5e4-48a7-92b2-7c00681261ae tempest-VolumesTransfersV355Test-484971139 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:57:15 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-6249a406-a5e4-48a7-92b2-7c00681261ae tempest-VolumesTransfersV355Test-484971139 None] Deleted volume successfully. Jun 24 09:57:15 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-6249a406-a5e4-48a7-92b2-7c00681261ae tempest-VolumesTransfersV355Test-484971139 None] Lock "cinder-e7519798-17a5-4701-9288-57bb81da1c30-delete_volume" released by "delete_volume" :: held 3.381s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:57:18 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:57:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Flow 'volume_create_manager' (d518b11b-f970-4d5d-a045-acf3b9a60530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:57:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9d57972-11ef-40e9-854e-35cc358131dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9d57972-11ef-40e9-854e-35cc358131dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf2960d8-f349-43f5-97bf-b582590b8cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d3ff32a3af45c1bd0939a62c34ead5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:57:18Z,use_quota=True,user_id='2ed78a30a51142b29fbb5345afbb21d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a5f1228-3af1-4cda-a7b6-5ed39a9738de),volume_type_id=1a5f1228-3af1-4cda-a7b6-5ed39a9738de)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d85edb-df93-4397-882b-ad05449d940c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d85edb-df93-4397-882b-ad05449d940c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4510c8ba-1c92-46a8-a7aa-517e8a777b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:18 devstack cinder-volume[93447]: DEBUG cinder.image.glance [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Creating Keystone auth plugin from conf {{(pid=93447) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 09:57:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4510c8ba-1c92-46a8-a7aa-517e8a777b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cf2960d8-f349-43f5-97bf-b582590b8cc8', 'volume_name': 'volume-cf2960d8-f349-43f5-97bf-b582590b8cc8', 'volume_size': 1, 'image_id': '913b1720-8d20-4a57-9f40-31e789868398', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/913b1720-8d20-4a57-9f40-31e789868398', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b5ad02d826937dc5b0a048538e49cc58', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '85d3ff32a3af45c1bd0939a62c34ead5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e9c209e49e886412c426c8b33ed67ef9e9d892b002cce83b113fb022b1742bab398197b71c71aa487f13477b95580d819249fd1072ddbcf9c5098afa4f60eb08', 'id': '913b1720-8d20-4a57-9f40-31e789868398', 'created_at': datetime.datetime(2026, 6, 24, 7, 57, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 7, 57, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/913b1720-8d20-4a57-9f40-31e789868398/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (849bda24-ea31-4d0f-8a46-3eb1645a5a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (849bda24-ea31-4d0f-8a46-3eb1645a5a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdce4970-9c85-4962-b997-8802ac70dc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:18 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Volume cf2960d8-f349-43f5-97bf-b582590b8cc8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cf2960d8-f349-43f5-97bf-b582590b8cc8', 'volume_size': 1, 'image_id': '913b1720-8d20-4a57-9f40-31e789868398', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/913b1720-8d20-4a57-9f40-31e789868398', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b5ad02d826937dc5b0a048538e49cc58', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '85d3ff32a3af45c1bd0939a62c34ead5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e9c209e49e886412c426c8b33ed67ef9e9d892b002cce83b113fb022b1742bab398197b71c71aa487f13477b95580d819249fd1072ddbcf9c5098afa4f60eb08', 'id': '913b1720-8d20-4a57-9f40-31e789868398', 'created_at': datetime.datetime(2026, 6, 24, 7, 57, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 7, 57, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/913b1720-8d20-4a57-9f40-31e789868398/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 24 09:57:18 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Trying to clone cf2960d8-f349-43f5-97bf-b582590b8cc8 from image 913b1720-8d20-4a57-9f40-31e789868398 at location (None, [{'url': 'file:///opt/stack/data/glance/images/913b1720-8d20-4a57-9f40-31e789868398', 'metadata': {}}]). {{(pid=93447) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 09:57:18 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 09:57:18 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Image download 0.00 MB at 0.00 MB/s Jun 24 09:57:18 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[716ca8ac-a3d8-444f-b682-d14b4832691a]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:57:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:19 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD Jun 24 09:57:19 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:19 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD" returned: 0 in 0.828s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:19 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD Jun 24 09:57:19 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:20 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD" returned: 1 in 0.873s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 09:57:20 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Temporary image 913b1720-8d20-4a57-9f40-31e789868398 is fetched for user 2ed78a30a51142b29fbb5345afbb21d9. {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 09:57:20 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d8293f-fb1a-4407-8569-c2b1cc47b052]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:57:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:20 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD Jun 24 09:57:20 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:21 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD" returned: 0 in 0.974s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:21 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD Jun 24 09:57:21 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:22 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD" returned: 1 in 0.971s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 09:57:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:57:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:57:22 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf2960d8-f349-43f5-97bf-b582590b8cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85d3ff32a3af45c1bd0939a62c34ead5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:57:18Z,use_quota=True,user_id='2ed78a30a51142b29fbb5345afbb21d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a5f1228-3af1-4cda-a7b6-5ed39a9738de),volume_type_id=1a5f1228-3af1-4cda-a7b6-5ed39a9738de)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:57:22 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Creating volume cf2960d8-f349-43f5-97bf-b582590b8cc8 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:57:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:57:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:57:22 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:57:22 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:57:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:57:22 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:57:22 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:57:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:22 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8 1073741824 Jun 24 09:57:22 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:23 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8 1073741824" returned: 0 in 1.162s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:23 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8 Jun 24 09:57:23 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:24 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8" returned: 0 in 0.826s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] <== create_volume: return (2050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:57:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:57:24 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Attempting download of 913b1720-8d20-4a57-9f40-31e789868398 ((None, [{'url': 'file:///opt/stack/data/glance/images/913b1720-8d20-4a57-9f40-31e789868398', 'metadata': {}}])) to volume cf2960d8-f349-43f5-97bf-b582590b8cc8. {{(pid=93447) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 09:57:24 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e094098-e305-4bf9-83d6-8704dc9cc4fe]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:57:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_913b1720-8d20-4a57-9f40-31e789868398_ph2ev4p0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:25 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_913b1720-8d20-4a57-9f40-31e789868398_ph2ev4p0 Jun 24 09:57:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:57:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:57:25 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:57:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:57:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:57:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:57:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:25 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:57:25 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:25 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.936s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:57:25 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:57:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 28 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 09:57:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 09:57:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_913b1720-8d20-4a57-9f40-31e789868398_ph2ev4p0" returned: 0 in 1.108s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_913b1720-8d20-4a57-9f40-31e789868398_ph2ev4p0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:26 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_913b1720-8d20-4a57-9f40-31e789868398_ph2ev4p0 Jun 24 09:57:26 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:27 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_913b1720-8d20-4a57-9f40-31e789868398_ph2ev4p0" returned: 1 in 1.589s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_913b1720-8d20-4a57-9f40-31e789868398_ph2ev4p0' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 09:57:27 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa37371d-b4d5-400e-953f-7f2f6121cf40]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:57:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:27 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD Jun 24 09:57:27 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:28 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:57:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Flow 'volume_create_manager' (af8907c8-0e65-49fc-8de8-50b70b85c69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:57:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75f5761-078e-4e6d-b3d2-61265b8aa2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75f5761-078e-4e6d-b3d2-61265b8aa2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2117186428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a2bfade-de66-4563-8fdc-0f90f850011a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b99afe4dc1f940ffa96a2863026beb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:57:28Z,use_quota=True,user_id='7c1b5bbea7ee4e819dd0eee9be60a9e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927d9cd0-b94a-4820-bdcb-1991a1d37a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927d9cd0-b94a-4820-bdcb-1991a1d37a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccedfa10-a748-481e-a32c-6233ad718424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:28 devstack cinder-volume[93447]: DEBUG cinder.image.glance [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Creating Keystone auth plugin from conf {{(pid=93447) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 09:57:28 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD" returned: 0 in 1.097s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:28 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD Jun 24 09:57:28 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccedfa10-a748-481e-a32c-6233ad718424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1a2bfade-de66-4563-8fdc-0f90f850011a', 'volume_name': 'volume-1a2bfade-de66-4563-8fdc-0f90f850011a', 'volume_size': 1, 'image_id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48394558c0ae48f385c046476f3b062e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'created_at': datetime.datetime(2026, 6, 24, 7, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 7, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3046b5bc-72b2-4780-bb3c-f346160219b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3046b5bc-72b2-4780-bb3c-f346160219b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d56bd7-89ce-4b50-87f0-bbf403009d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:29 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Volume 1a2bfade-de66-4563-8fdc-0f90f850011a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1a2bfade-de66-4563-8fdc-0f90f850011a', 'volume_size': 1, 'image_id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48394558c0ae48f385c046476f3b062e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'created_at': datetime.datetime(2026, 6, 24, 7, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 7, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 24 09:57:29 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Trying to clone 1a2bfade-de66-4563-8fdc-0f90f850011a from image cd371dd7-fca0-4345-9276-7b2a9b23d2c0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'metadata': {}}]). {{(pid=93447) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 09:57:29 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_dcuo4q3rdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 09:57:29 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Image download 20.69 MB at 20.69 MB/s Jun 24 09:57:29 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD" returned: 1 in 0.958s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 09:57:29 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] 913b1720-8d20-4a57-9f40-31e789868398 was raw, converting to raw {{(pid=93447) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 09:57:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:29 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d036fa87-5b34-4d1b-928b-d1464facfa88]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:57:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_dcuo4q3rdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:29 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8 Jun 24 09:57:29 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:29 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_dcuo4q3rdevstack@QuobyteHD Jun 24 09:57:29 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:30 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8" returned: 0 in 0.871s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:30 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_913b1720-8d20-4a57-9f40-31e789868398_d4n225frdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8 {{(pid=93447) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 09:57:30 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Converted 0.00 MB image at 0.00 MB/s Jun 24 09:57:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:30 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_dcuo4q3rdevstack@QuobyteHD" returned: 0 in 0.881s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:30 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Temporary image cd371dd7-fca0-4345-9276-7b2a9b23d2c0 is fetched for user 7c1b5bbea7ee4e819dd0eee9be60a9e8. {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 09:57:30 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8 1G Jun 24 09:57:30 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:30 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c623a88-c025-4da0-b591-d0b153b64b8d]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:57:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_dcuo4q3rdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:30 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_dcuo4q3rdevstack@QuobyteHD Jun 24 09:57:30 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:31 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_dcuo4q3rdevstack@QuobyteHD" returned: 0 in 1.010s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:57:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:57:31 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2117186428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a2bfade-de66-4563-8fdc-0f90f850011a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b99afe4dc1f940ffa96a2863026beb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:57:28Z,use_quota=True,user_id='7c1b5bbea7ee4e819dd0eee9be60a9e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:57:31 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Creating volume 1a2bfade-de66-4563-8fdc-0f90f850011a {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:57:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:57:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:57:31 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:57:31 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:57:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:57:31 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:57:31 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:57:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:31 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a 1073741824 Jun 24 09:57:31 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:31 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8 1G" returned: 0 in 1.283s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:31 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f946193-326a-46ec-b11d-567751061784]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:57:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:32 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8 Jun 24 09:57:32 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:33 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a 1073741824" returned: 0 in 1.326s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:33 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8" returned: 0 in 1.249s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:33 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a Jun 24 09:57:33 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:33 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8 Jun 24 09:57:33 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:34 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a" returned: 0 in 1.016s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] <== create_volume: return (2439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.445s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Attempting download of cd371dd7-fca0-4345-9276-7b2a9b23d2c0 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'metadata': {}}])) to volume 1a2bfade-de66-4563-8fdc-0f90f850011a. {{(pid=93447) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7a3849-519a-4dbe-8e3a-cfe3e2d530d8]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_q_p7llvd {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:34 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_q_p7llvd Jun 24 09:57:34 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Flow 'volume_create_manager' (52dde169-cd41-4911-916b-5c09b54e98c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb11027a-2c9a-4a40-bf2a-cd72133a1ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb11027a-2c9a-4a40-bf2a-cd72133a1ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-323641891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8532d6e1-2482-48b5-81ba-75a78266b5f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='132b58385a9a40ee9df0964661440f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:57:35Z,use_quota=True,user_id='b6cdc74933c94e5bba460847969425f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1e00a7-80db-46da-a175-f9edef4f6aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1e00a7-80db-46da-a175-f9edef4f6aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26f2bb2-7c78-47b3-af2d-d3a0afc49481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d26f2bb2-7c78-47b3-af2d-d3a0afc49481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8532d6e1-2482-48b5-81ba-75a78266b5f8', 'volume_name': 'volume-8532d6e1-2482-48b5-81ba-75a78266b5f8', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef8fc54-b904-4063-8b73-dd9b72144aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef8fc54-b904-4063-8b73-dd9b72144aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9860a07-7f49-4066-9189-f92722bfd72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:34 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Volume 8532d6e1-2482-48b5-81ba-75a78266b5f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8532d6e1-2482-48b5-81ba-75a78266b5f8', 'volume_size': 1} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-323641891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8532d6e1-2482-48b5-81ba-75a78266b5f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='132b58385a9a40ee9df0964661440f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:57:35Z,use_quota=True,user_id='b6cdc74933c94e5bba460847969425f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Creating volume 8532d6e1-2482-48b5-81ba-75a78266b5f8 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:57:34 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8532d6e1-2482-48b5-81ba-75a78266b5f8 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:34 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8532d6e1-2482-48b5-81ba-75a78266b5f8 1073741824 Jun 24 09:57:34 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:34 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8" returned: 1 in 1.816s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Downloaded image 913b1720-8d20-4a57-9f40-31e789868398 ((None, [{'url': 'file:///opt/stack/data/glance/images/913b1720-8d20-4a57-9f40-31e789868398', 'metadata': {}}])) to volume cf2960d8-f349-43f5-97bf-b582590b8cc8 successfully. {{(pid=93447) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Temporary image 913b1720-8d20-4a57-9f40-31e789868398 for user 2ed78a30a51142b29fbb5345afbb21d9 is deleted. {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Marking volume cf2960d8-f349-43f5-97bf-b582590b8cc8 as bootable. {{(pid=93447) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Copying metadata from image 913b1720-8d20-4a57-9f40-31e789868398 to cf2960d8-f349-43f5-97bf-b582590b8cc8. {{(pid=93447) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 09:57:34 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Creating volume glance metadata for volume cf2960d8-f349-43f5-97bf-b582590b8cc8 backed by image 913b1720-8d20-4a57-9f40-31e789868398 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '913b1720-8d20-4a57-9f40-31e789868398', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b5ad02d826937dc5b0a048538e49cc58', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93447) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 09:57:35 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdce4970-9c85-4962-b997-8802ac70dc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf2960d8-f349-43f5-97bf-b582590b8cc8', 'volume_size': 1, 'image_id': '913b1720-8d20-4a57-9f40-31e789868398', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/913b1720-8d20-4a57-9f40-31e789868398', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b5ad02d826937dc5b0a048538e49cc58', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '85d3ff32a3af45c1bd0939a62c34ead5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e9c209e49e886412c426c8b33ed67ef9e9d892b002cce83b113fb022b1742bab398197b71c71aa487f13477b95580d819249fd1072ddbcf9c5098afa4f60eb08', 'id': '913b1720-8d20-4a57-9f40-31e789868398', 'created_at': datetime.datetime(2026, 6, 24, 7, 57, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 7, 57, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/913b1720-8d20-4a57-9f40-31e789868398/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:35 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2215ed-3c60-4bd6-854c-4430995cc809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:35 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:35 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Volume volume-cf2960d8-f349-43f5-97bf-b582590b8cc8 (cf2960d8-f349-43f5-97bf-b582590b8cc8): created successfully Jun 24 09:57:35 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f2215ed-3c60-4bd6-854c-4430995cc809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:35 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Flow 'volume_create_manager' (d518b11b-f970-4d5d-a045-acf3b9a60530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:57:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_q_p7llvd" returned: 0 in 0.956s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_q_p7llvd {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:35 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-4aaf020b-3004-4abd-9140-a35c09e4eaf4 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Created volume successfully. Jun 24 09:57:35 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_q_p7llvd Jun 24 09:57:35 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:35 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Acquiring lock "cinder-cf2960d8-f349-43f5-97bf-b582590b8cc8-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:57:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Lock "cinder-cf2960d8-f349-43f5-97bf-b582590b8cc8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:57:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Acquiring lock "cinder-quobyte-cf2960d8-f349-43f5-97bf-b582590b8cc8" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:57:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Lock "cinder-quobyte-cf2960d8-f349-43f5-97bf-b582590b8cc8" acquired by "delete_volume" :: waited 0.031s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:57:36 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f2b56b-0492-45d0-9856-ab19c9cbd0a2]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:57:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:36 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8 Jun 24 09:57:36 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:36 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8532d6e1-2482-48b5-81ba-75a78266b5f8 1073741824" returned: 0 in 1.980s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8532d6e1-2482-48b5-81ba-75a78266b5f8 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:36 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_q_p7llvd" returned: 1 in 1.641s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_q_p7llvd' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 09:57:36 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc837acb-ad1e-44b0-8776-50118a381902]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:57:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_dcuo4q3rdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:36 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8532d6e1-2482-48b5-81ba-75a78266b5f8 Jun 24 09:57:36 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:37 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_dcuo4q3rdevstack@QuobyteHD Jun 24 09:57:37 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:37 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8" returned: 0 in 1.549s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:37 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8532d6e1-2482-48b5-81ba-75a78266b5f8" returned: 0 in 1.103s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:37 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] <== create_volume: return (3194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:57:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.199s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:57:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9860a07-7f49-4066-9189-f92722bfd72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8532d6e1-2482-48b5-81ba-75a78266b5f8', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7cb101-87fc-44f2-bcf8-45d738ea76f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:38 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Volume volume-8532d6e1-2482-48b5-81ba-75a78266b5f8 (8532d6e1-2482-48b5-81ba-75a78266b5f8): created successfully Jun 24 09:57:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7cb101-87fc-44f2-bcf8-45d738ea76f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Flow 'volume_create_manager' (52dde169-cd41-4911-916b-5c09b54e98c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:57:38 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-0eb239da-8a84-4cc6-acda-d76a37247d28 tempest-VolumesActionsTest-1065443444 None] Created volume successfully. Jun 24 09:57:38 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8 Jun 24 09:57:38 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:38 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_dcuo4q3rdevstack@QuobyteHD" returned: 0 in 1.627s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:38 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] cd371dd7-fca0-4345-9276-7b2a9b23d2c0 was qcow2, converting to raw {{(pid=93447) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 09:57:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_dcuo4q3rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:38 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_dcuo4q3rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a Jun 24 09:57:38 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-219c59b0-a22b-48c9-8892-69dc12dce832 tempest-VolumesActionsTest-1065443444 None] Acquiring lock "cinder-8532d6e1-2482-48b5-81ba-75a78266b5f8" by "attach_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:57:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-219c59b0-a22b-48c9-8892-69dc12dce832 tempest-VolumesActionsTest-1065443444 None] Lock "cinder-8532d6e1-2482-48b5-81ba-75a78266b5f8" acquired by "attach_volume" :: waited 0.047s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:57:39 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-219c59b0-a22b-48c9-8892-69dc12dce832 tempest-VolumesActionsTest-1065443444 None] Attaching volume 8532d6e1-2482-48b5-81ba-75a78266b5f8 to instance edbae7df-10f6-4aa6-8dbb-20abbdfba97b at mountpoint /dev/vdb on host None. Jun 24 09:57:39 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-219c59b0-a22b-48c9-8892-69dc12dce832 tempest-VolumesActionsTest-1065443444 None] Attach volume completed successfully. Jun 24 09:57:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-219c59b0-a22b-48c9-8892-69dc12dce832 tempest-VolumesActionsTest-1065443444 None] Lock "cinder-8532d6e1-2482-48b5-81ba-75a78266b5f8" released by "attach_volume" :: held 0.174s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:57:39 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8" returned: 1 in 1.503s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 09:57:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:39 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8 Jun 24 09:57:39 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:40 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf2960d8-f349-43f5-97bf-b582590b8cc8" returned: 0 in 1.020s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Lock "cinder-quobyte-cf2960d8-f349-43f5-97bf-b582590b8cc8" released by "delete_volume" :: held 4.234s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:57:40 devstack cinder-volume[93447]: WARNING cinder.quota [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:57:40 devstack cinder-volume[93447]: WARNING cinder.quota [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 24 09:57:40 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Created reservations ['bea51c04-d759-4c28-bc4c-f9f8ba310d0e', '75f79cbb-e3a3-4ad2-b8aa-87b66c1fc460', '96058274-15e6-473a-9530-27629e415776', '2f675f8c-7135-4c35-9e9b-5c9b8555d501'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:57:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:57:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:57:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:57:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:57:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:57:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:40 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:57:40 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:40 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-c52272b3-bedd-45f4-8181-d3e8ef60451a tempest-VolumesActionsTest-1955046214 None] Terminate volume connection completed successfully. Jun 24 09:57:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c52272b3-bedd-45f4-8181-d3e8ef60451a tempest-VolumesActionsTest-1955046214 None] Acquiring lock "cinder-8532d6e1-2482-48b5-81ba-75a78266b5f8-detach_volume" by "detach_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:57:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c52272b3-bedd-45f4-8181-d3e8ef60451a tempest-VolumesActionsTest-1955046214 None] Lock "cinder-8532d6e1-2482-48b5-81ba-75a78266b5f8-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:57:41 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-c52272b3-bedd-45f4-8181-d3e8ef60451a tempest-VolumesActionsTest-1955046214 None] Detaching volume 8532d6e1-2482-48b5-81ba-75a78266b5f8 from instance edbae7df-10f6-4aa6-8dbb-20abbdfba97b. Jun 24 09:57:41 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-c52272b3-bedd-45f4-8181-d3e8ef60451a tempest-VolumesActionsTest-1955046214 None] Detach volume completed successfully. Jun 24 09:57:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c52272b3-bedd-45f4-8181-d3e8ef60451a tempest-VolumesActionsTest-1955046214 None] Lock "cinder-8532d6e1-2482-48b5-81ba-75a78266b5f8-detach_volume" released by "detach_volume" :: held 0.229s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:57:42 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_dcuo4q3rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a" returned: 0 in 3.549s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:42 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_dcuo4q3rdevstack@QuobyteHD, size 112.00 MB, duration 3.55 sec, destination /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a {{(pid=93447) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 09:57:42 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Converted 112.00 MB image at 31.55 MB/s Jun 24 09:57:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:42 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a 1G Jun 24 09:57:42 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:42 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fc08c7fc-ebfd-4ab7-90d0-8b836019118c tempest-VolumesActionsTest-1065443444 None] Acquiring lock "cinder-8532d6e1-2482-48b5-81ba-75a78266b5f8-detach_volume" by "detach_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:57:42 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fc08c7fc-ebfd-4ab7-90d0-8b836019118c tempest-VolumesActionsTest-1065443444 None] Lock "cinder-8532d6e1-2482-48b5-81ba-75a78266b5f8-detach_volume" acquired by "detach_volume" :: waited 0.057s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:57:42 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-fc08c7fc-ebfd-4ab7-90d0-8b836019118c tempest-VolumesActionsTest-1065443444 None] Volume detach called, but volume not attached. Jun 24 09:57:42 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:42 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fc08c7fc-ebfd-4ab7-90d0-8b836019118c tempest-VolumesActionsTest-1065443444 None] Lock "cinder-8532d6e1-2482-48b5-81ba-75a78266b5f8-detach_volume" released by "detach_volume" :: held 0.047s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:57:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.719s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:42 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:57:42 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Deleted volume successfully. Jun 24 09:57:42 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0551843d-6876-4774-8b4a-be7093e68219 tempest-VolumeAndVolumeTypeFromImageTest-2010532873 None] Lock "cinder-cf2960d8-f349-43f5-97bf-b582590b8cc8-delete_volume" released by "delete_volume" :: held 6.420s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:57:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b9865e12-9d67-4499-96fa-5ce3abab8fad tempest-VolumesActionsTest-1065443444 None] Acquiring lock "cinder-8532d6e1-2482-48b5-81ba-75a78266b5f8-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:57:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b9865e12-9d67-4499-96fa-5ce3abab8fad tempest-VolumesActionsTest-1065443444 None] Lock "cinder-8532d6e1-2482-48b5-81ba-75a78266b5f8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:57:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b9865e12-9d67-4499-96fa-5ce3abab8fad tempest-VolumesActionsTest-1065443444 None] Acquiring lock "cinder-quobyte-8532d6e1-2482-48b5-81ba-75a78266b5f8" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:57:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b9865e12-9d67-4499-96fa-5ce3abab8fad tempest-VolumesActionsTest-1065443444 None] Lock "cinder-quobyte-8532d6e1-2482-48b5-81ba-75a78266b5f8" acquired by "delete_volume" :: waited 0.040s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:57:43 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c395855-b6f5-473d-ac8e-ff27763b637b]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:57:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b9865e12-9d67-4499-96fa-5ce3abab8fad tempest-VolumesActionsTest-1065443444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8532d6e1-2482-48b5-81ba-75a78266b5f8 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:43 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a 1G" returned: 0 in 1.346s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:43 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8532d6e1-2482-48b5-81ba-75a78266b5f8 Jun 24 09:57:43 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:43 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea92871-d32f-4014-ab6c-ee5b667be841]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:57:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:43 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a Jun 24 09:57:43 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:44 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:57:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Flow 'volume_create_manager' (4762bf6a-a402-4965-a1ac-670d7cc20165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:57:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e219cd5a-4688-4d3b-8e53-b081493ffe28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e219cd5a-4688-4d3b-8e53-b081493ffe28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-842821216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eecee40f-e2ce-4533-9c02-120deda5da48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c3790e192f419d835f13963979e164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:57:44Z,use_quota=True,user_id='2efaf650a6ff41249c81d2388f85bd8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a28eff3-ff53-433d-be67-2769f2719baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a28eff3-ff53-433d-be67-2769f2719baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abcac24a-ddc5-4474-b0db-d6934e36be54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abcac24a-ddc5-4474-b0db-d6934e36be54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eecee40f-e2ce-4533-9c02-120deda5da48', 'volume_name': 'volume-eecee40f-e2ce-4533-9c02-120deda5da48', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d6e950-f2bf-4cfe-84ac-a1be03e16942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d6e950-f2bf-4cfe-84ac-a1be03e16942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b53ddef-e648-435f-98b6-65248a13fc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:44 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Volume eecee40f-e2ce-4533-9c02-120deda5da48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eecee40f-e2ce-4533-9c02-120deda5da48', 'volume_size': 1} Jun 24 09:57:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:57:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:57:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-842821216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eecee40f-e2ce-4533-9c02-120deda5da48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9c3790e192f419d835f13963979e164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:57:44Z,use_quota=True,user_id='2efaf650a6ff41249c81d2388f85bd8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:57:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Creating volume eecee40f-e2ce-4533-9c02-120deda5da48 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:57:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:57:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:57:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:57:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:57:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:57:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:57:44 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:57:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:44 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 1073741824 Jun 24 09:57:44 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:44 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b9865e12-9d67-4499-96fa-5ce3abab8fad tempest-VolumesActionsTest-1065443444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8532d6e1-2482-48b5-81ba-75a78266b5f8" returned: 0 in 1.429s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b9865e12-9d67-4499-96fa-5ce3abab8fad tempest-VolumesActionsTest-1065443444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8532d6e1-2482-48b5-81ba-75a78266b5f8 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:44 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8532d6e1-2482-48b5-81ba-75a78266b5f8 Jun 24 09:57:44 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:45 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a" returned: 0 in 1.507s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:45 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a Jun 24 09:57:45 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:45 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 1073741824" returned: 0 in 1.065s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:45 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 Jun 24 09:57:45 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:45 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b9865e12-9d67-4499-96fa-5ce3abab8fad tempest-VolumesActionsTest-1065443444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8532d6e1-2482-48b5-81ba-75a78266b5f8" returned: 0 in 0.835s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b9865e12-9d67-4499-96fa-5ce3abab8fad tempest-VolumesActionsTest-1065443444 None] Lock "cinder-quobyte-8532d6e1-2482-48b5-81ba-75a78266b5f8" released by "delete_volume" :: held 2.365s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:57:45 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-b9865e12-9d67-4499-96fa-5ce3abab8fad tempest-VolumesActionsTest-1065443444 None] Created reservations ['b4a1c158-eac9-4bb3-ab78-3d4b0e470f6c', '9bb774f7-e4dc-4f95-a81f-f4c0a02b09c2', '0d4038b4-1a8b-4a88-9e0c-3c2b6fd44d71', '89e9924b-4c1c-426f-a8fa-214f881f83d4'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:57:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b9865e12-9d67-4499-96fa-5ce3abab8fad tempest-VolumesActionsTest-1065443444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:57:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b9865e12-9d67-4499-96fa-5ce3abab8fad tempest-VolumesActionsTest-1065443444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:57:45 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b9865e12-9d67-4499-96fa-5ce3abab8fad tempest-VolumesActionsTest-1065443444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:57:45 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b9865e12-9d67-4499-96fa-5ce3abab8fad tempest-VolumesActionsTest-1065443444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:57:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b9865e12-9d67-4499-96fa-5ce3abab8fad tempest-VolumesActionsTest-1065443444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:57:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b9865e12-9d67-4499-96fa-5ce3abab8fad tempest-VolumesActionsTest-1065443444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:45 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:57:45 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:46 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a" returned: 1 in 1.080s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 09:57:46 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Downloaded image cd371dd7-fca0-4345-9276-7b2a9b23d2c0 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'metadata': {}}])) to volume 1a2bfade-de66-4563-8fdc-0f90f850011a successfully. {{(pid=93447) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 09:57:46 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Temporary image cd371dd7-fca0-4345-9276-7b2a9b23d2c0 for user 7c1b5bbea7ee4e819dd0eee9be60a9e8 is deleted. {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 09:57:46 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Marking volume 1a2bfade-de66-4563-8fdc-0f90f850011a as bootable. {{(pid=93447) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 09:57:46 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Copying metadata from image cd371dd7-fca0-4345-9276-7b2a9b23d2c0 to 1a2bfade-de66-4563-8fdc-0f90f850011a. {{(pid=93447) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 09:57:46 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Creating volume glance metadata for volume 1a2bfade-de66-4563-8fdc-0f90f850011a backed by image cd371dd7-fca0-4345-9276-7b2a9b23d2c0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93447) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 09:57:46 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48" returned: 0 in 0.924s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] <== create_volume: return (2061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:57:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.068s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:57:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d56bd7-89ce-4b50-87f0-bbf403009d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a2bfade-de66-4563-8fdc-0f90f850011a', 'volume_size': 1, 'image_id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48394558c0ae48f385c046476f3b062e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'created_at': datetime.datetime(2026, 6, 24, 7, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 7, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1199fe4-2318-4437-9a09-085d20cc62f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b53ddef-e648-435f-98b6-65248a13fc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eecee40f-e2ce-4533-9c02-120deda5da48', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37808e02-8381-471a-9b3e-f19d6c036e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:46 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Volume volume-1a2bfade-de66-4563-8fdc-0f90f850011a (1a2bfade-de66-4563-8fdc-0f90f850011a): created successfully Jun 24 09:57:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1199fe4-2318-4437-9a09-085d20cc62f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Flow 'volume_create_manager' (af8907c8-0e65-49fc-8de8-50b70b85c69f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:57:46 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Volume volume-eecee40f-e2ce-4533-9c02-120deda5da48 (eecee40f-e2ce-4533-9c02-120deda5da48): created successfully Jun 24 09:57:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37808e02-8381-471a-9b3e-f19d6c036e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Flow 'volume_create_manager' (4762bf6a-a402-4965-a1ac-670d7cc20165) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:57:46 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-49d7fbd3-3b2c-4182-812a-4b366dc777ed tempest-TestShelveInstance-1737251020 None] Created volume successfully. Jun 24 09:57:46 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-1448fadf-df95-4272-8fea-c4824b0036a6 tempest-VolumesActionsTest-1427458989 None] Created volume successfully. Jun 24 09:57:46 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b9865e12-9d67-4499-96fa-5ce3abab8fad tempest-VolumesActionsTest-1065443444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.765s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:46 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-b9865e12-9d67-4499-96fa-5ce3abab8fad tempest-VolumesActionsTest-1065443444 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:57:46 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-b9865e12-9d67-4499-96fa-5ce3abab8fad tempest-VolumesActionsTest-1065443444 None] Deleted volume successfully. Jun 24 09:57:46 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b9865e12-9d67-4499-96fa-5ce3abab8fad tempest-VolumesActionsTest-1065443444 None] Lock "cinder-8532d6e1-2482-48b5-81ba-75a78266b5f8-delete_volume" released by "delete_volume" :: held 3.452s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:57:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-e7024604-d7eb-4142-9378-b9f496b55de4 req-0caa0a94-a634-4f82-8b2d-37f8b0321457 tempest-TestShelveInstance-1737251020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:57:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-e7024604-d7eb-4142-9378-b9f496b55de4 req-0caa0a94-a634-4f82-8b2d-37f8b0321457 tempest-TestShelveInstance-1737251020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:57:55 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[65536aeb-01f6-4398-be36-4e8181189452]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:57:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-e7024604-d7eb-4142-9378-b9f496b55de4 req-0caa0a94-a634-4f82-8b2d-37f8b0321457 tempest-TestShelveInstance-1737251020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:55 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a Jun 24 09:57:55 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:55 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-e7024604-d7eb-4142-9378-b9f496b55de4 req-0caa0a94-a634-4f82-8b2d-37f8b0321457 tempest-TestShelveInstance-1737251020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a" returned: 0 in 0.950s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-e7024604-d7eb-4142-9378-b9f496b55de4 req-0caa0a94-a634-4f82-8b2d-37f8b0321457 tempest-TestShelveInstance-1737251020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:56 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a Jun 24 09:57:56 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:57:56 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jun 24 09:57:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-e7024604-d7eb-4142-9378-b9f496b55de4 req-0caa0a94-a634-4f82-8b2d-37f8b0321457 tempest-TestShelveInstance-1737251020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a" returned: 1 in 1.001s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:57:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-e7024604-d7eb-4142-9378-b9f496b55de4 req-0caa0a94-a634-4f82-8b2d-37f8b0321457 tempest-TestShelveInstance-1737251020 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 09:57:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-e7024604-d7eb-4142-9378-b9f496b55de4 req-0caa0a94-a634-4f82-8b2d-37f8b0321457 tempest-TestShelveInstance-1737251020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.016s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:57:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-e7024604-d7eb-4142-9378-b9f496b55de4 req-0caa0a94-a634-4f82-8b2d-37f8b0321457 tempest-TestShelveInstance-1737251020 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb', 'name': 'volume-1a2bfade-de66-4563-8fdc-0f90f850011a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6e94dda-5fed-415e-b4f4-318b9ab6860d', 'enforce_multipath': True} {{(pid=93447) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 09:57:57 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-e7024604-d7eb-4142-9378-b9f496b55de4 req-0caa0a94-a634-4f82-8b2d-37f8b0321457 tempest-TestShelveInstance-1737251020 None] attachment_update completed successfully. Jun 24 09:57:59 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:57:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Flow 'volume_create_manager' (520f23b6-5da0-4691-a93d-a7f94b261948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:57:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dfaf898-48b8-41f5-b3a1-7e3a75dfab1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dfaf898-48b8-41f5-b3a1-7e3a75dfab1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1372642200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e2b4fa0-8670-4400-94ff-ead6cc67ed77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='132b58385a9a40ee9df0964661440f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:57:59Z,use_quota=True,user_id='b6cdc74933c94e5bba460847969425f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5effdc28-6711-477c-a5fd-ac4da5eae359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5effdc28-6711-477c-a5fd-ac4da5eae359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1362e813-4eb7-4c90-9db9-bfe452d10ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1362e813-4eb7-4c90-9db9-bfe452d10ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e2b4fa0-8670-4400-94ff-ead6cc67ed77', 'volume_name': 'volume-0e2b4fa0-8670-4400-94ff-ead6cc67ed77', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41c68d6e-f38f-49f5-acc4-207c8b3e3ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41c68d6e-f38f-49f5-acc4-207c8b3e3ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:57:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a2c590-3cbb-4adb-bc71-a011faf1f940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:57:59 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Volume 0e2b4fa0-8670-4400-94ff-ead6cc67ed77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e2b4fa0-8670-4400-94ff-ead6cc67ed77', 'volume_size': 1} Jun 24 09:57:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:57:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:57:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1372642200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e2b4fa0-8670-4400-94ff-ead6cc67ed77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='132b58385a9a40ee9df0964661440f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:57:59Z,use_quota=True,user_id='b6cdc74933c94e5bba460847969425f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:57:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Creating volume 0e2b4fa0-8670-4400-94ff-ead6cc67ed77 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:57:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:57:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:57:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:57:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:57:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:57:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:57:59 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:57:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0e2b4fa0-8670-4400-94ff-ead6cc67ed77 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:57:59 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0e2b4fa0-8670-4400-94ff-ead6cc67ed77 1073741824 Jun 24 09:57:59 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:00 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0e2b4fa0-8670-4400-94ff-ead6cc67ed77 1073741824" returned: 0 in 1.057s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0e2b4fa0-8670-4400-94ff-ead6cc67ed77 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:00 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0e2b4fa0-8670-4400-94ff-ead6cc67ed77 Jun 24 09:58:00 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:01 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0e2b4fa0-8670-4400-94ff-ead6cc67ed77" returned: 0 in 0.752s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:01 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:58:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:58:01 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a2c590-3cbb-4adb-bc71-a011faf1f940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e2b4fa0-8670-4400-94ff-ead6cc67ed77', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:01 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a99df7e-f36f-47ca-8d92-fbf28a81e1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:01 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Volume volume-0e2b4fa0-8670-4400-94ff-ead6cc67ed77 (0e2b4fa0-8670-4400-94ff-ead6cc67ed77): created successfully Jun 24 09:58:01 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a99df7e-f36f-47ca-8d92-fbf28a81e1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:01 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Flow 'volume_create_manager' (520f23b6-5da0-4691-a93d-a7f94b261948) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:58:01 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-6f89ce72-5ffb-488a-adef-3812dcbc9172 tempest-VolumesActionsTest-1065443444 None] Created volume successfully. Jun 24 09:58:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4dbe7921-2aba-48af-b527-c051dcc2a676 tempest-VolumesActionsTest-1955046214 None] Acquiring lock "cinder-0e2b4fa0-8670-4400-94ff-ead6cc67ed77-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:58:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4dbe7921-2aba-48af-b527-c051dcc2a676 tempest-VolumesActionsTest-1955046214 None] Lock "cinder-0e2b4fa0-8670-4400-94ff-ead6cc67ed77-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:58:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4dbe7921-2aba-48af-b527-c051dcc2a676 tempest-VolumesActionsTest-1955046214 None] Acquiring lock "cinder-quobyte-0e2b4fa0-8670-4400-94ff-ead6cc67ed77" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:58:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4dbe7921-2aba-48af-b527-c051dcc2a676 tempest-VolumesActionsTest-1955046214 None] Lock "cinder-quobyte-0e2b4fa0-8670-4400-94ff-ead6cc67ed77" acquired by "delete_volume" :: waited 0.016s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:58:02 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50ba7cb-89b2-4cd5-b2d7-4dbb55137348]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:58:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4dbe7921-2aba-48af-b527-c051dcc2a676 tempest-VolumesActionsTest-1955046214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0e2b4fa0-8670-4400-94ff-ead6cc67ed77 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:02 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0e2b4fa0-8670-4400-94ff-ead6cc67ed77 Jun 24 09:58:02 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:03 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4dbe7921-2aba-48af-b527-c051dcc2a676 tempest-VolumesActionsTest-1955046214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0e2b4fa0-8670-4400-94ff-ead6cc67ed77" returned: 0 in 0.966s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4dbe7921-2aba-48af-b527-c051dcc2a676 tempest-VolumesActionsTest-1955046214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0e2b4fa0-8670-4400-94ff-ead6cc67ed77 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:03 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0e2b4fa0-8670-4400-94ff-ead6cc67ed77 Jun 24 09:58:03 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:04 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4dbe7921-2aba-48af-b527-c051dcc2a676 tempest-VolumesActionsTest-1955046214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0e2b4fa0-8670-4400-94ff-ead6cc67ed77" returned: 0 in 0.832s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:04 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4dbe7921-2aba-48af-b527-c051dcc2a676 tempest-VolumesActionsTest-1955046214 None] Lock "cinder-quobyte-0e2b4fa0-8670-4400-94ff-ead6cc67ed77" released by "delete_volume" :: held 1.884s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:58:04 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=67,cinder:UPDATE=67,cinder:INSERT=29,cinder:DELETE=7 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:58:04 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-4dbe7921-2aba-48af-b527-c051dcc2a676 tempest-VolumesActionsTest-1955046214 None] Created reservations ['99420a80-cabf-41b8-8d6c-90bc32bc668a', '86c0b005-649f-4b20-b16d-4e1807bde645', 'a38d362f-d03d-4fbf-b9d9-e8dd7434af31', '7af19b36-01e6-488d-8a08-6b71bca7e8d1'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:58:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4dbe7921-2aba-48af-b527-c051dcc2a676 tempest-VolumesActionsTest-1955046214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:58:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4dbe7921-2aba-48af-b527-c051dcc2a676 tempest-VolumesActionsTest-1955046214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:58:04 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4dbe7921-2aba-48af-b527-c051dcc2a676 tempest-VolumesActionsTest-1955046214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:58:04 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4dbe7921-2aba-48af-b527-c051dcc2a676 tempest-VolumesActionsTest-1955046214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:58:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4dbe7921-2aba-48af-b527-c051dcc2a676 tempest-VolumesActionsTest-1955046214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:58:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4dbe7921-2aba-48af-b527-c051dcc2a676 tempest-VolumesActionsTest-1955046214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:04 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:58:04 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=78,cinder:INSERT=29,cinder:UPDATE=87,cinder:DELETE=4 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Flow 'volume_create_manager' (abdf5060-277a-4764-8d37-0556d3b922be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b92c849-2877-43c5-90d4-cb9cd26bf46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b92c849-2877-43c5-90d4-cb9cd26bf46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-105472458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0101d3-e3dd-41a3-aedf-12e0d685b342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='132b58385a9a40ee9df0964661440f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:58:05Z,use_quota=True,user_id='b6cdc74933c94e5bba460847969425f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:05 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26408e5-44db-41c5-a854-745b326e8101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26408e5-44db-41c5-a854-745b326e8101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580d3216-058f-4e0a-95e6-75c871a5ed43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580d3216-058f-4e0a-95e6-75c871a5ed43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af0101d3-e3dd-41a3-aedf-12e0d685b342', 'volume_name': 'volume-af0101d3-e3dd-41a3-aedf-12e0d685b342', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7afdea3f-2ec2-42e1-9008-65ff414fd46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7afdea3f-2ec2-42e1-9008-65ff414fd46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49114d44-aa6e-44bd-99c6-e1a2e2c45d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:05 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Volume af0101d3-e3dd-41a3-aedf-12e0d685b342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af0101d3-e3dd-41a3-aedf-12e0d685b342', 'volume_size': 1} Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-105472458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0101d3-e3dd-41a3-aedf-12e0d685b342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='132b58385a9a40ee9df0964661440f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:58:05Z,use_quota=True,user_id='b6cdc74933c94e5bba460847969425f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Creating volume af0101d3-e3dd-41a3-aedf-12e0d685b342 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:58:05 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-af0101d3-e3dd-41a3-aedf-12e0d685b342 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4dbe7921-2aba-48af-b527-c051dcc2a676 tempest-VolumesActionsTest-1955046214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.041s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-4dbe7921-2aba-48af-b527-c051dcc2a676 tempest-VolumesActionsTest-1955046214 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:58:05 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-4dbe7921-2aba-48af-b527-c051dcc2a676 tempest-VolumesActionsTest-1955046214 None] Deleted volume successfully. Jun 24 09:58:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4dbe7921-2aba-48af-b527-c051dcc2a676 tempest-VolumesActionsTest-1955046214 None] Lock "cinder-0e2b4fa0-8670-4400-94ff-ead6cc67ed77-delete_volume" released by "delete_volume" :: held 3.255s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:58:05 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-af0101d3-e3dd-41a3-aedf-12e0d685b342 1073741824 Jun 24 09:58:05 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:07 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-af0101d3-e3dd-41a3-aedf-12e0d685b342 1073741824" returned: 0 in 1.541s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-af0101d3-e3dd-41a3-aedf-12e0d685b342 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:07 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-af0101d3-e3dd-41a3-aedf-12e0d685b342 Jun 24 09:58:07 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:08 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-af0101d3-e3dd-41a3-aedf-12e0d685b342" returned: 0 in 1.433s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] <== create_volume: return (3044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:58:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.047s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:58:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49114d44-aa6e-44bd-99c6-e1a2e2c45d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af0101d3-e3dd-41a3-aedf-12e0d685b342', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2eef7e0-bc7a-41d4-b252-05a235d0a998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:08 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Volume volume-af0101d3-e3dd-41a3-aedf-12e0d685b342 (af0101d3-e3dd-41a3-aedf-12e0d685b342): created successfully Jun 24 09:58:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2eef7e0-bc7a-41d4-b252-05a235d0a998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Flow 'volume_create_manager' (abdf5060-277a-4764-8d37-0556d3b922be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:58:08 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-d2e820ee-aa91-4ce6-af63-1039dd5bb6cf tempest-VolumesActionsTest-1065443444 None] Created volume successfully. Jun 24 09:58:10 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c73f15bb-982c-4b3a-9e9c-9f2753e8a7f4 tempest-VolumesActionsTest-1955046214 None] Acquiring lock "cinder-af0101d3-e3dd-41a3-aedf-12e0d685b342-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:58:10 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c73f15bb-982c-4b3a-9e9c-9f2753e8a7f4 tempest-VolumesActionsTest-1955046214 None] Lock "cinder-af0101d3-e3dd-41a3-aedf-12e0d685b342-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:58:10 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c73f15bb-982c-4b3a-9e9c-9f2753e8a7f4 tempest-VolumesActionsTest-1955046214 None] Acquiring lock "cinder-quobyte-af0101d3-e3dd-41a3-aedf-12e0d685b342" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:58:10 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c73f15bb-982c-4b3a-9e9c-9f2753e8a7f4 tempest-VolumesActionsTest-1955046214 None] Lock "cinder-quobyte-af0101d3-e3dd-41a3-aedf-12e0d685b342" acquired by "delete_volume" :: waited 0.031s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:58:10 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ada287-deb6-4caf-a72c-4c4d842b5e3c]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:58:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c73f15bb-982c-4b3a-9e9c-9f2753e8a7f4 tempest-VolumesActionsTest-1955046214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-af0101d3-e3dd-41a3-aedf-12e0d685b342 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:11 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-af0101d3-e3dd-41a3-aedf-12e0d685b342 Jun 24 09:58:11 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:12 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c73f15bb-982c-4b3a-9e9c-9f2753e8a7f4 tempest-VolumesActionsTest-1955046214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-af0101d3-e3dd-41a3-aedf-12e0d685b342" returned: 0 in 1.460s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c73f15bb-982c-4b3a-9e9c-9f2753e8a7f4 tempest-VolumesActionsTest-1955046214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-af0101d3-e3dd-41a3-aedf-12e0d685b342 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:12 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-af0101d3-e3dd-41a3-aedf-12e0d685b342 Jun 24 09:58:12 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4639fce3-068f-47b9-be83-4a2f5fc7b939 tempest-VolumesActionsTest-1427458989 None] Acquiring lock "cinder-eecee40f-e2ce-4533-9c02-120deda5da48" by "attach_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:58:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4639fce3-068f-47b9-be83-4a2f5fc7b939 tempest-VolumesActionsTest-1427458989 None] Lock "cinder-eecee40f-e2ce-4533-9c02-120deda5da48" acquired by "attach_volume" :: waited 0.021s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:58:12 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-4639fce3-068f-47b9-be83-4a2f5fc7b939 tempest-VolumesActionsTest-1427458989 None] Attaching volume eecee40f-e2ce-4533-9c02-120deda5da48 to instance 1e769107-fc22-4bef-88a2-3d0f92ad6d1d at mountpoint /dev/vdb on host None. Jun 24 09:58:13 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-4639fce3-068f-47b9-be83-4a2f5fc7b939 tempest-VolumesActionsTest-1427458989 None] Attach volume completed successfully. Jun 24 09:58:13 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4639fce3-068f-47b9-be83-4a2f5fc7b939 tempest-VolumesActionsTest-1427458989 None] Lock "cinder-eecee40f-e2ce-4533-9c02-120deda5da48" released by "attach_volume" :: held 0.229s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:58:13 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5cedb199-410b-4b1a-82c9-13e02397fdc4 tempest-VolumesActionsTest-1427458989 None] Acquiring lock "cinder-eecee40f-e2ce-4533-9c02-120deda5da48-detach_volume" by "detach_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:58:13 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5cedb199-410b-4b1a-82c9-13e02397fdc4 tempest-VolumesActionsTest-1427458989 None] Lock "cinder-eecee40f-e2ce-4533-9c02-120deda5da48-detach_volume" acquired by "detach_volume" :: waited 0.062s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:58:13 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-5cedb199-410b-4b1a-82c9-13e02397fdc4 tempest-VolumesActionsTest-1427458989 None] Detaching volume eecee40f-e2ce-4533-9c02-120deda5da48 from instance 1e769107-fc22-4bef-88a2-3d0f92ad6d1d. Jun 24 09:58:13 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-5cedb199-410b-4b1a-82c9-13e02397fdc4 tempest-VolumesActionsTest-1427458989 None] Detach volume completed successfully. Jun 24 09:58:13 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5cedb199-410b-4b1a-82c9-13e02397fdc4 tempest-VolumesActionsTest-1427458989 None] Lock "cinder-eecee40f-e2ce-4533-9c02-120deda5da48-detach_volume" released by "detach_volume" :: held 0.216s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:58:14 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c73f15bb-982c-4b3a-9e9c-9f2753e8a7f4 tempest-VolumesActionsTest-1955046214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-af0101d3-e3dd-41a3-aedf-12e0d685b342" returned: 0 in 2.190s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:14 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c73f15bb-982c-4b3a-9e9c-9f2753e8a7f4 tempest-VolumesActionsTest-1955046214 None] Lock "cinder-quobyte-af0101d3-e3dd-41a3-aedf-12e0d685b342" released by "delete_volume" :: held 3.748s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:58:14 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-c73f15bb-982c-4b3a-9e9c-9f2753e8a7f4 tempest-VolumesActionsTest-1955046214 None] Created reservations ['0b007cb8-ba6c-4be4-b68a-a8ea1174bed3', '3d87ee5d-7823-41a4-8b01-fea4de7c89ee', '18cb3c13-07d3-4481-9f4f-7bdb1a64f7e0', '2a5c72ef-9fb6-4d98-93a2-a4053e98962f'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:58:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c73f15bb-982c-4b3a-9e9c-9f2753e8a7f4 tempest-VolumesActionsTest-1955046214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:58:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c73f15bb-982c-4b3a-9e9c-9f2753e8a7f4 tempest-VolumesActionsTest-1955046214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:58:14 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c73f15bb-982c-4b3a-9e9c-9f2753e8a7f4 tempest-VolumesActionsTest-1955046214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:58:14 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c73f15bb-982c-4b3a-9e9c-9f2753e8a7f4 tempest-VolumesActionsTest-1955046214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:58:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c73f15bb-982c-4b3a-9e9c-9f2753e8a7f4 tempest-VolumesActionsTest-1955046214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:58:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c73f15bb-982c-4b3a-9e9c-9f2753e8a7f4 tempest-VolumesActionsTest-1955046214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:15 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:58:15 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:16 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c73f15bb-982c-4b3a-9e9c-9f2753e8a7f4 tempest-VolumesActionsTest-1955046214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.285s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:16 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-c73f15bb-982c-4b3a-9e9c-9f2753e8a7f4 tempest-VolumesActionsTest-1955046214 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:58:16 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-c73f15bb-982c-4b3a-9e9c-9f2753e8a7f4 tempest-VolumesActionsTest-1955046214 None] Deleted volume successfully. Jun 24 09:58:16 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c73f15bb-982c-4b3a-9e9c-9f2753e8a7f4 tempest-VolumesActionsTest-1955046214 None] Lock "cinder-af0101d3-e3dd-41a3-aedf-12e0d685b342-delete_volume" released by "delete_volume" :: held 5.667s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Flow 'volume_create_manager' (8b5e6993-12c2-473d-8060-4deb9fd13850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd76b14-0167-4927-9d52-d6252464b163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Flow 'volume_create_manager' (7fd70aa0-a475-42da-9026-96db9c692382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f624c7-cc9d-43cb-a37b-d32d85de74bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd76b14-0167-4927-9d52-d6252464b163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-968416644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79280d6f-7e90-4965-bf12-b4a7b0c598dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3640da380cb0452ca51ed5c309474006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:58:17Z,use_quota=True,user_id='694a6ffcfa3342919177f257bdb7c9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a783e18-9d8e-45cb-bb6f-50d7affc0084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a783e18-9d8e-45cb-bb6f-50d7affc0084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ec28ab-e4d8-440c-96d1-d775c3918f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ec28ab-e4d8-440c-96d1-d775c3918f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79280d6f-7e90-4965-bf12-b4a7b0c598dc', 'volume_name': 'volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db72417b-5b74-4007-ad20-0411cf29cdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db72417b-5b74-4007-ad20-0411cf29cdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf86e69-7585-4c42-a273-f17b42fef433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:17 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Volume 79280d6f-7e90-4965-bf12-b4a7b0c598dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc', 'volume_size': 1} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-968416644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79280d6f-7e90-4965-bf12-b4a7b0c598dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3640da380cb0452ca51ed5c309474006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:58:17Z,use_quota=True,user_id='694a6ffcfa3342919177f257bdb7c9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Creating volume 79280d6f-7e90-4965-bf12-b4a7b0c598dc {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:58:17 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f624c7-cc9d-43cb-a37b-d32d85de74bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1612988634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1f21ed0-6b9c-417a-bd68-8412446b988b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='132b58385a9a40ee9df0964661440f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:58:17Z,use_quota=True,user_id='b6cdc74933c94e5bba460847969425f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f94cde6a-059b-48e7-87ff-e976619010ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f94cde6a-059b-48e7-87ff-e976619010ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36bdd01-8c18-4a52-94a9-17abbb8e89fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36bdd01-8c18-4a52-94a9-17abbb8e89fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1f21ed0-6b9c-417a-bd68-8412446b988b', 'volume_name': 'volume-d1f21ed0-6b9c-417a-bd68-8412446b988b', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b789a1-8de1-4ee1-90c2-bebb7761f4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:17 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc 1073741824 Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b789a1-8de1-4ee1-90c2-bebb7761f4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:17 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dddaac3-954d-4f3b-abe1-995bfbc604d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:17 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Volume d1f21ed0-6b9c-417a-bd68-8412446b988b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1f21ed0-6b9c-417a-bd68-8412446b988b', 'volume_size': 1} Jun 24 09:58:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:58:18 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc 1073741824" returned: 0 in 1.238s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:18 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc Jun 24 09:58:18 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:19 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc" returned: 0 in 0.689s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:19 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] <== create_volume: return (1983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:58:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:58:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.912s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:58:19 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1612988634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1f21ed0-6b9c-417a-bd68-8412446b988b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='132b58385a9a40ee9df0964661440f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:58:17Z,use_quota=True,user_id='b6cdc74933c94e5bba460847969425f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:58:19 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Creating volume d1f21ed0-6b9c-417a-bd68-8412446b988b {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:58:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:58:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:58:19 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:58:19 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:58:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:58:19 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:58:19 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:58:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d1f21ed0-6b9c-417a-bd68-8412446b988b 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:19 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d1f21ed0-6b9c-417a-bd68-8412446b988b 1073741824 Jun 24 09:58:19 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf86e69-7585-4c42-a273-f17b42fef433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1cef1a2-97f2-4b34-b932-f686389eaf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:19 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Volume volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc (79280d6f-7e90-4965-bf12-b4a7b0c598dc): created successfully Jun 24 09:58:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1cef1a2-97f2-4b34-b932-f686389eaf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Flow 'volume_create_manager' (8b5e6993-12c2-473d-8060-4deb9fd13850) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:58:19 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-40ed2345-5552-43e7-beb2-6727e25eb134 tempest-SnapshotDependencyTests-1094195029 None] Created volume successfully. Jun 24 09:58:20 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d1f21ed0-6b9c-417a-bd68-8412446b988b 1073741824" returned: 0 in 0.989s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d1f21ed0-6b9c-417a-bd68-8412446b988b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:20 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d1f21ed0-6b9c-417a-bd68-8412446b988b Jun 24 09:58:20 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c8b8bab9-6991-4cd1-b115-d1cf2e74658b tempest-SnapshotDependencyTests-1094195029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:58:21 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d1f21ed0-6b9c-417a-bd68-8412446b988b" returned: 0 in 0.750s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:58:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:58:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c8b8bab9-6991-4cd1-b115-d1cf2e74658b tempest-SnapshotDependencyTests-1094195029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.630s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:58:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dddaac3-954d-4f3b-abe1-995bfbc604d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1f21ed0-6b9c-417a-bd68-8412446b988b', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba64f529-d876-42db-ac06-50d6cb06478b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-c8b8bab9-6991-4cd1-b115-d1cf2e74658b tempest-SnapshotDependencyTests-1094195029 None] Creating offline snapshot 9c73985c-ed33-4d86-a26c-38c711bfd65b of volume 79280d6f-7e90-4965-bf12-b4a7b0c598dc {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 09:58:21 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Volume volume-d1f21ed0-6b9c-417a-bd68-8412446b988b (d1f21ed0-6b9c-417a-bd68-8412446b988b): created successfully Jun 24 09:58:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba64f529-d876-42db-ac06-50d6cb06478b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Flow 'volume_create_manager' (7fd70aa0-a475-42da-9026-96db9c692382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:58:21 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[39793138-f9c6-4a98-acc7-d3f58a16ff6a]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:58:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c8b8bab9-6991-4cd1-b115-d1cf2e74658b tempest-SnapshotDependencyTests-1094195029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:21 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-a45ef3f2-cafd-4151-a24e-eff44b76fada tempest-VolumesActionsTest-1065443444 None] Created volume successfully. Jun 24 09:58:21 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc Jun 24 09:58:21 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:22 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c8b8bab9-6991-4cd1-b115-d1cf2e74658b tempest-SnapshotDependencyTests-1094195029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc" returned: 0 in 0.883s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c8b8bab9-6991-4cd1-b115-d1cf2e74658b tempest-SnapshotDependencyTests-1094195029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.9c73985c-ed33-4d86-a26c-38c711bfd65b 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:22 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.9c73985c-ed33-4d86-a26c-38c711bfd65b 1G Jun 24 09:58:22 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:22 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-48019390-4e31-4947-9ef5-3b86b702f926 tempest-VolumesActionsTest-1955046214 None] Acquiring lock "cinder-d1f21ed0-6b9c-417a-bd68-8412446b988b-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:58:22 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-48019390-4e31-4947-9ef5-3b86b702f926 tempest-VolumesActionsTest-1955046214 None] Lock "cinder-d1f21ed0-6b9c-417a-bd68-8412446b988b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:58:22 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-48019390-4e31-4947-9ef5-3b86b702f926 tempest-VolumesActionsTest-1955046214 None] Acquiring lock "cinder-quobyte-d1f21ed0-6b9c-417a-bd68-8412446b988b" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:58:22 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-48019390-4e31-4947-9ef5-3b86b702f926 tempest-VolumesActionsTest-1955046214 None] Lock "cinder-quobyte-d1f21ed0-6b9c-417a-bd68-8412446b988b" acquired by "delete_volume" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:58:22 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3046dd3-5535-4ca8-a5c5-91bbdcbd8b53]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:58:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-48019390-4e31-4947-9ef5-3b86b702f926 tempest-VolumesActionsTest-1955046214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d1f21ed0-6b9c-417a-bd68-8412446b988b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:22 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d1f21ed0-6b9c-417a-bd68-8412446b988b Jun 24 09:58:22 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:23 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c8b8bab9-6991-4cd1-b115-d1cf2e74658b tempest-SnapshotDependencyTests-1094195029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.9c73985c-ed33-4d86-a26c-38c711bfd65b 1G" returned: 0 in 1.134s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c8b8bab9-6991-4cd1-b115-d1cf2e74658b tempest-SnapshotDependencyTests-1094195029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.9c73985c-ed33-4d86-a26c-38c711bfd65b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:23 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.9c73985c-ed33-4d86-a26c-38c711bfd65b Jun 24 09:58:23 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:23 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-48019390-4e31-4947-9ef5-3b86b702f926 tempest-VolumesActionsTest-1955046214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d1f21ed0-6b9c-417a-bd68-8412446b988b" returned: 0 in 1.182s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-48019390-4e31-4947-9ef5-3b86b702f926 tempest-VolumesActionsTest-1955046214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d1f21ed0-6b9c-417a-bd68-8412446b988b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:23 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d1f21ed0-6b9c-417a-bd68-8412446b988b Jun 24 09:58:23 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:24 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c8b8bab9-6991-4cd1-b115-d1cf2e74658b tempest-SnapshotDependencyTests-1094195029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.9c73985c-ed33-4d86-a26c-38c711bfd65b" returned: 0 in 1.042s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:24 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-c8b8bab9-6991-4cd1-b115-d1cf2e74658b tempest-SnapshotDependencyTests-1094195029 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.9c73985c-ed33-4d86-a26c-38c711bfd65b is being set with open permissions: ugo+rw Jun 24 09:58:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c8b8bab9-6991-4cd1-b115-d1cf2e74658b tempest-SnapshotDependencyTests-1094195029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.9c73985c-ed33-4d86-a26c-38c711bfd65b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:24 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.9c73985c-ed33-4d86-a26c-38c711bfd65b Jun 24 09:58:24 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:24 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-48019390-4e31-4947-9ef5-3b86b702f926 tempest-VolumesActionsTest-1955046214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d1f21ed0-6b9c-417a-bd68-8412446b988b" returned: 0 in 0.850s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:24 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-48019390-4e31-4947-9ef5-3b86b702f926 tempest-VolumesActionsTest-1955046214 None] Lock "cinder-quobyte-d1f21ed0-6b9c-417a-bd68-8412446b988b" released by "delete_volume" :: held 2.092s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:58:24 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-48019390-4e31-4947-9ef5-3b86b702f926 tempest-VolumesActionsTest-1955046214 None] Created reservations ['14f31884-75f8-4e4b-b211-83f1b2bf8561', '53cf21a1-3e1d-4b92-bde7-1285d292bcf4', '8d351d6f-182e-4643-ab38-a06267cad9dc', '80cddbdf-7c7b-47e8-b10c-03365cb8d08f'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:58:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-48019390-4e31-4947-9ef5-3b86b702f926 tempest-VolumesActionsTest-1955046214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:58:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-48019390-4e31-4947-9ef5-3b86b702f926 tempest-VolumesActionsTest-1955046214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:58:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-48019390-4e31-4947-9ef5-3b86b702f926 tempest-VolumesActionsTest-1955046214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:58:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-48019390-4e31-4947-9ef5-3b86b702f926 tempest-VolumesActionsTest-1955046214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:58:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-48019390-4e31-4947-9ef5-3b86b702f926 tempest-VolumesActionsTest-1955046214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:58:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-48019390-4e31-4947-9ef5-3b86b702f926 tempest-VolumesActionsTest-1955046214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:25 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:58:25 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:58:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:58:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:58:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:58:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:58:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:58:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:25 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:58:25 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:25 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c8b8bab9-6991-4cd1-b115-d1cf2e74658b tempest-SnapshotDependencyTests-1094195029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.9c73985c-ed33-4d86-a26c-38c711bfd65b" returned: 0 in 0.849s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c8b8bab9-6991-4cd1-b115-d1cf2e74658b tempest-SnapshotDependencyTests-1094195029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:25 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.info Jun 24 09:58:25 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:25 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-48019390-4e31-4947-9ef5-3b86b702f926 tempest-VolumesActionsTest-1955046214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.812s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-48019390-4e31-4947-9ef5-3b86b702f926 tempest-VolumesActionsTest-1955046214 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:58:25 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-48019390-4e31-4947-9ef5-3b86b702f926 tempest-VolumesActionsTest-1955046214 None] Deleted volume successfully. Jun 24 09:58:25 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-48019390-4e31-4947-9ef5-3b86b702f926 tempest-VolumesActionsTest-1955046214 None] Lock "cinder-d1f21ed0-6b9c-417a-bd68-8412446b988b-delete_volume" released by "delete_volume" :: held 3.233s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:58:25 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.889s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:58:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:58:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 28 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 09:58:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 09:58:26 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c8b8bab9-6991-4cd1-b115-d1cf2e74658b tempest-SnapshotDependencyTests-1094195029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.info" returned: 0 in 0.997s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:26 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-c8b8bab9-6991-4cd1-b115-d1cf2e74658b tempest-SnapshotDependencyTests-1094195029 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.info is being set with open permissions: ugo+rw Jun 24 09:58:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c8b8bab9-6991-4cd1-b115-d1cf2e74658b tempest-SnapshotDependencyTests-1094195029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:26 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.info Jun 24 09:58:26 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:26 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:58:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Flow 'volume_create_manager' (bb369859-a909-4455-b685-e291b25f04ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:58:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ede5a1-f5b3-4f22-a0d8-e0a2b38f460c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ede5a1-f5b3-4f22-a0d8-e0a2b38f460c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-159183972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7217709a-c4c2-4b8f-b340-710f6ff2f616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='132b58385a9a40ee9df0964661440f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:58:27Z,use_quota=True,user_id='b6cdc74933c94e5bba460847969425f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713bc393-cb7d-4182-affa-be2061e7285c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713bc393-cb7d-4182-affa-be2061e7285c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f3058e6-3cd4-4f79-a785-73edede5b4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f3058e6-3cd4-4f79-a785-73edede5b4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7217709a-c4c2-4b8f-b340-710f6ff2f616', 'volume_name': 'volume-7217709a-c4c2-4b8f-b340-710f6ff2f616', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc79eee8-9150-4a05-9874-a9a59e785a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc79eee8-9150-4a05-9874-a9a59e785a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e9f91f-9351-4dd9-8de6-8ecbeaca069c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:26 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Volume 7217709a-c4c2-4b8f-b340-710f6ff2f616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7217709a-c4c2-4b8f-b340-710f6ff2f616', 'volume_size': 1} Jun 24 09:58:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:58:27 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c8b8bab9-6991-4cd1-b115-d1cf2e74658b tempest-SnapshotDependencyTests-1094195029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.info" returned: 0 in 0.716s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c8b8bab9-6991-4cd1-b115-d1cf2e74658b tempest-SnapshotDependencyTests-1094195029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.758s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:58:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.425s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:58:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-159183972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7217709a-c4c2-4b8f-b340-710f6ff2f616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='132b58385a9a40ee9df0964661440f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:58:27Z,use_quota=True,user_id='b6cdc74933c94e5bba460847969425f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:58:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Creating volume 7217709a-c4c2-4b8f-b340-710f6ff2f616 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:58:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:58:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:58:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:58:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:58:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:58:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:58:27 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:58:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7217709a-c4c2-4b8f-b340-710f6ff2f616 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:27 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7217709a-c4c2-4b8f-b340-710f6ff2f616 1073741824 Jun 24 09:58:27 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:27 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-c8b8bab9-6991-4cd1-b115-d1cf2e74658b tempest-SnapshotDependencyTests-1094195029 None] Create snapshot completed successfully Jun 24 09:58:28 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7217709a-c4c2-4b8f-b340-710f6ff2f616 1073741824" returned: 0 in 0.892s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7217709a-c4c2-4b8f-b340-710f6ff2f616 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:28 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7217709a-c4c2-4b8f-b340-710f6ff2f616 Jun 24 09:58:28 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:28 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:58:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Flow 'volume_create_manager' (c7a43c7c-b545-487b-a7fa-7e8f6a0a0bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:58:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac6cf08-0661-4165-b8b0-2a339beddb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:28 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7217709a-c4c2-4b8f-b340-710f6ff2f616" returned: 0 in 0.900s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:28 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:58:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac6cf08-0661-4165-b8b0-2a339beddb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:58:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=742d2e95-bd6d-4afd-8180-6fd5b13eb97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3640da380cb0452ca51ed5c309474006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9c73985c-ed33-4d86-a26c-38c711bfd65b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:58:29Z,use_quota=True,user_id='694a6ffcfa3342919177f257bdb7c9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada98bd0-5f6a-40c6-9ae0-96c7c6220008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada98bd0-5f6a-40c6-9ae0-96c7c6220008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41cd3dd-6620-4e3b-a64b-0aa44048c0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41cd3dd-6620-4e3b-a64b-0aa44048c0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '742d2e95-bd6d-4afd-8180-6fd5b13eb97b', 'volume_name': 'volume-742d2e95-bd6d-4afd-8180-6fd5b13eb97b', 'volume_size': 1, 'snapshot_id': '9c73985c-ed33-4d86-a26c-38c711bfd65b'}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55710d2-04af-49ee-be06-b95910a441aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55710d2-04af-49ee-be06-b95910a441aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06c937e-e4ab-4184-bf22-73b0338ba59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:29 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Volume 742d2e95-bd6d-4afd-8180-6fd5b13eb97b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-742d2e95-bd6d-4afd-8180-6fd5b13eb97b', 'volume_size': 1, 'snapshot_id': '9c73985c-ed33-4d86-a26c-38c711bfd65b'} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e9f91f-9351-4dd9-8de6-8ecbeaca069c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7217709a-c4c2-4b8f-b340-710f6ff2f616', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355a637c-5414-4c81-8f37-3dd9c32a0791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Acquiring lock "cinder-quobyte-9c73985c-ed33-4d86-a26c-38c711bfd65b-742d2e95-bd6d-4afd-8180-6fd5b13eb97b" by "_create_volume_from_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:58:29 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Volume volume-7217709a-c4c2-4b8f-b340-710f6ff2f616 (7217709a-c4c2-4b8f-b340-710f6ff2f616): created successfully Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355a637c-5414-4c81-8f37-3dd9c32a0791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Flow 'volume_create_manager' (bb369859-a909-4455-b685-e291b25f04ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Lock "cinder-quobyte-9c73985c-ed33-4d86-a26c-38c711bfd65b-742d2e95-bd6d-4afd-8180-6fd5b13eb97b" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Creating volume 742d2e95-bd6d-4afd-8180-6fd5b13eb97b from snapshot 9c73985c-ed33-4d86-a26c-38c711bfd65b {{(pid=93447) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Acquiring lock "cinder-quobyte-742d2e95-bd6d-4afd-8180-6fd5b13eb97b" by "_copy_volume_from_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:58:29 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-8cc3db28-a252-4424-81ef-1415bb00f92e tempest-VolumesActionsTest-1065443444 None] Created volume successfully. Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Lock "cinder-quobyte-742d2e95-bd6d-4afd-8180-6fd5b13eb97b" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] snapshot: 9c73985c-ed33-4d86-a26c-38c711bfd65b, volume: 742d2e95-bd6d-4afd-8180-6fd5b13eb97b, {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efadc55-1b3f-436c-b7e2-37c12c758956]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:58:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.9c73985c-ed33-4d86-a26c-38c711bfd65b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:29 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.9c73985c-ed33-4d86-a26c-38c711bfd65b Jun 24 09:58:29 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:30 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d81dfe7a-6e3f-45ed-b4cd-f6fb57b8cfd1 tempest-VolumesActionsTest-1955046214 None] Acquiring lock "cinder-7217709a-c4c2-4b8f-b340-710f6ff2f616-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:58:30 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d81dfe7a-6e3f-45ed-b4cd-f6fb57b8cfd1 tempest-VolumesActionsTest-1955046214 None] Lock "cinder-7217709a-c4c2-4b8f-b340-710f6ff2f616-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:58:30 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.9c73985c-ed33-4d86-a26c-38c711bfd65b" returned: 0 in 0.910s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:30 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:58:30 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 09:58:30 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Creating direct copy from snapshot {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 09:58:30 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d81dfe7a-6e3f-45ed-b4cd-f6fb57b8cfd1 tempest-VolumesActionsTest-1955046214 None] Acquiring lock "cinder-quobyte-7217709a-c4c2-4b8f-b340-710f6ff2f616" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:58:30 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d81dfe7a-6e3f-45ed-b4cd-f6fb57b8cfd1 tempest-VolumesActionsTest-1955046214 None] Lock "cinder-quobyte-7217709a-c4c2-4b8f-b340-710f6ff2f616" acquired by "delete_volume" :: waited 0.016s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:58:30 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14b5e56-a05c-423e-81c0-d625ff9d340a]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:58:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:30 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51b96a6-99a8-4df3-bd8a-905acfcbe1ba]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:58:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d81dfe7a-6e3f-45ed-b4cd-f6fb57b8cfd1 tempest-VolumesActionsTest-1955046214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7217709a-c4c2-4b8f-b340-710f6ff2f616 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:30 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc Jun 24 09:58:30 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:30 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7217709a-c4c2-4b8f-b340-710f6ff2f616 Jun 24 09:58:30 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:30 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc" returned: 0 in 0.819s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:30 devstack cinder-volume[93447]: DEBUG cinder.utils [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Path /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-742d2e95-bd6d-4afd-8180-6fd5b13eb97b not found in is_blk_device check {{(pid=93447) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 09:58:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-742d2e95-bd6d-4afd-8180-6fd5b13eb97b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:30 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d81dfe7a-6e3f-45ed-b4cd-f6fb57b8cfd1 tempest-VolumesActionsTest-1955046214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7217709a-c4c2-4b8f-b340-710f6ff2f616" returned: 0 in 0.830s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d81dfe7a-6e3f-45ed-b4cd-f6fb57b8cfd1 tempest-VolumesActionsTest-1955046214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7217709a-c4c2-4b8f-b340-710f6ff2f616 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:31 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-742d2e95-bd6d-4afd-8180-6fd5b13eb97b Jun 24 09:58:31 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:31 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7217709a-c4c2-4b8f-b340-710f6ff2f616 Jun 24 09:58:31 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:31 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d81dfe7a-6e3f-45ed-b4cd-f6fb57b8cfd1 tempest-VolumesActionsTest-1955046214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7217709a-c4c2-4b8f-b340-710f6ff2f616" returned: 0 in 0.651s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d81dfe7a-6e3f-45ed-b4cd-f6fb57b8cfd1 tempest-VolumesActionsTest-1955046214 None] Lock "cinder-quobyte-7217709a-c4c2-4b8f-b340-710f6ff2f616" released by "delete_volume" :: held 1.521s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:58:31 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-d81dfe7a-6e3f-45ed-b4cd-f6fb57b8cfd1 tempest-VolumesActionsTest-1955046214 None] Created reservations ['39a4bc40-b8b7-41b0-9d3e-c74957d04b96', '566ee0d5-b499-430a-85ed-0f8f50c6c690', '28870c51-a3ae-4987-8be2-e57ca834fc73', 'd1e2b726-bcda-45e0-9b95-94439b33055e'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:58:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d81dfe7a-6e3f-45ed-b4cd-f6fb57b8cfd1 tempest-VolumesActionsTest-1955046214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:58:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d81dfe7a-6e3f-45ed-b4cd-f6fb57b8cfd1 tempest-VolumesActionsTest-1955046214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:58:31 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d81dfe7a-6e3f-45ed-b4cd-f6fb57b8cfd1 tempest-VolumesActionsTest-1955046214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:58:31 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d81dfe7a-6e3f-45ed-b4cd-f6fb57b8cfd1 tempest-VolumesActionsTest-1955046214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:58:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d81dfe7a-6e3f-45ed-b4cd-f6fb57b8cfd1 tempest-VolumesActionsTest-1955046214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:58:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d81dfe7a-6e3f-45ed-b4cd-f6fb57b8cfd1 tempest-VolumesActionsTest-1955046214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:31 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:58:31 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:33 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:58:33 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Flow 'volume_create_manager' (b13484c0-f350-4e12-b7c2-6b3d676d3adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:58:33 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ea741b-a740-4b11-8263-29f7c246dcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:33 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ea741b-a740-4b11-8263-29f7c246dcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-150727531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0024ad89-4742-46ba-9bf3-4d0340b87b26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='132b58385a9a40ee9df0964661440f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:58:34Z,use_quota=True,user_id='b6cdc74933c94e5bba460847969425f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:33 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c683447e-cda8-4841-ab73-42f33d91351b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:33 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c683447e-cda8-4841-ab73-42f33d91351b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:33 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf74cef9-342d-4ea5-82a3-004efb70cf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:33 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf74cef9-342d-4ea5-82a3-004efb70cf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0024ad89-4742-46ba-9bf3-4d0340b87b26', 'volume_name': 'volume-0024ad89-4742-46ba-9bf3-4d0340b87b26', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:33 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b34021-76b6-4c3a-97ac-430b459f1dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:33 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b34021-76b6-4c3a-97ac-430b459f1dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:33 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb500624-87a6-40b6-93a8-70ad6c7e9b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:33 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Volume 0024ad89-4742-46ba-9bf3-4d0340b87b26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0024ad89-4742-46ba-9bf3-4d0340b87b26', 'volume_size': 1} Jun 24 09:58:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:58:33 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d81dfe7a-6e3f-45ed-b4cd-f6fb57b8cfd1 tempest-VolumesActionsTest-1955046214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 2.092s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:34 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-d81dfe7a-6e3f-45ed-b4cd-f6fb57b8cfd1 tempest-VolumesActionsTest-1955046214 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:58:34 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-d81dfe7a-6e3f-45ed-b4cd-f6fb57b8cfd1 tempest-VolumesActionsTest-1955046214 None] Deleted volume successfully. Jun 24 09:58:34 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d81dfe7a-6e3f-45ed-b4cd-f6fb57b8cfd1 tempest-VolumesActionsTest-1955046214 None] Lock "cinder-7217709a-c4c2-4b8f-b340-710f6ff2f616-delete_volume" released by "delete_volume" :: held 3.990s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:58:37 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-742d2e95-bd6d-4afd-8180-6fd5b13eb97b" returned: 0 in 6.211s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:37 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b57c12-2edd-42f0-9871-5489d8a1d391]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:58:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:37 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc Jun 24 09:58:37 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:38 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc" returned: 0 in 1.633s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:38 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc, size 1024.00 MB, duration 6.21 sec, destination /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-742d2e95-bd6d-4afd-8180-6fd5b13eb97b {{(pid=93447) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 09:58:38 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Converted 1024.00 MB image at 164.85 MB/s Jun 24 09:58:38 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-742d2e95-bd6d-4afd-8180-6fd5b13eb97b is being set with open permissions: ugo+rw Jun 24 09:58:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-742d2e95-bd6d-4afd-8180-6fd5b13eb97b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:38 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-742d2e95-bd6d-4afd-8180-6fd5b13eb97b Jun 24 09:58:38 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:39 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-742d2e95-bd6d-4afd-8180-6fd5b13eb97b" returned: 0 in 0.724s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Lock "cinder-quobyte-742d2e95-bd6d-4afd-8180-6fd5b13eb97b" released by "_copy_volume_from_snapshot" :: held 10.450s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:58:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Lock "cinder-quobyte-9c73985c-ed33-4d86-a26c-38c711bfd65b-742d2e95-bd6d-4afd-8180-6fd5b13eb97b" released by "_create_volume_from_snapshot" :: held 10.507s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:58:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.541s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:58:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.664s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:58:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-150727531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0024ad89-4742-46ba-9bf3-4d0340b87b26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='132b58385a9a40ee9df0964661440f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:58:34Z,use_quota=True,user_id='b6cdc74933c94e5bba460847969425f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:58:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Creating volume 0024ad89-4742-46ba-9bf3-4d0340b87b26 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:58:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:58:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:58:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:58:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:58:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:58:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:58:39 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:58:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0024ad89-4742-46ba-9bf3-4d0340b87b26 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:39 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0024ad89-4742-46ba-9bf3-4d0340b87b26 1073741824 Jun 24 09:58:39 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06c937e-e4ab-4184-bf22-73b0338ba59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-742d2e95-bd6d-4afd-8180-6fd5b13eb97b', 'volume_size': 1, 'snapshot_id': '9c73985c-ed33-4d86-a26c-38c711bfd65b'}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358388eb-feca-419d-ad39-6369fd2edce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:39 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Volume volume-742d2e95-bd6d-4afd-8180-6fd5b13eb97b (742d2e95-bd6d-4afd-8180-6fd5b13eb97b): created successfully Jun 24 09:58:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358388eb-feca-419d-ad39-6369fd2edce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Flow 'volume_create_manager' (c7a43c7c-b545-487b-a7fa-7e8f6a0a0bbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:58:39 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-b571392a-ed15-49b5-9d2f-0fe3451d124b tempest-SnapshotDependencyTests-1094195029 None] Created volume successfully. Jun 24 09:58:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-343ddeaf-b8cb-44f0-8fe3-b944f309586c tempest-SnapshotDependencyTests-1094195029 None] Acquiring lock "cinder-9c73985c-ed33-4d86-a26c-38c711bfd65b-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:58:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-343ddeaf-b8cb-44f0-8fe3-b944f309586c tempest-SnapshotDependencyTests-1094195029 None] Lock "cinder-9c73985c-ed33-4d86-a26c-38c711bfd65b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:58:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-343ddeaf-b8cb-44f0-8fe3-b944f309586c tempest-SnapshotDependencyTests-1094195029 None] Acquiring lock "cinder-quobyte-79280d6f-7e90-4965-bf12-b4a7b0c598dc" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:58:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-343ddeaf-b8cb-44f0-8fe3-b944f309586c tempest-SnapshotDependencyTests-1094195029 None] Lock "cinder-quobyte-79280d6f-7e90-4965-bf12-b4a7b0c598dc" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:58:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-343ddeaf-b8cb-44f0-8fe3-b944f309586c tempest-SnapshotDependencyTests-1094195029 None] Acquiring lock "cinder-quobyte-9c73985c-ed33-4d86-a26c-38c711bfd65b" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:58:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-343ddeaf-b8cb-44f0-8fe3-b944f309586c tempest-SnapshotDependencyTests-1094195029 None] Lock "cinder-quobyte-9c73985c-ed33-4d86-a26c-38c711bfd65b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:58:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-343ddeaf-b8cb-44f0-8fe3-b944f309586c tempest-SnapshotDependencyTests-1094195029 None] Deleting offline snapshot 9c73985c-ed33-4d86-a26c-38c711bfd65b of volume 79280d6f-7e90-4965-bf12-b4a7b0c598dc {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 09:58:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-343ddeaf-b8cb-44f0-8fe3-b944f309586c tempest-SnapshotDependencyTests-1094195029 None] snapshot_file for this snap is: volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.9c73985c-ed33-4d86-a26c-38c711bfd65b {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 09:58:40 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c64dee-2092-428d-88f3-7dbdce521930]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:58:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-343ddeaf-b8cb-44f0-8fe3-b944f309586c tempest-SnapshotDependencyTests-1094195029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.9c73985c-ed33-4d86-a26c-38c711bfd65b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:41 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.9c73985c-ed33-4d86-a26c-38c711bfd65b Jun 24 09:58:41 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:41 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0024ad89-4742-46ba-9bf3-4d0340b87b26 1073741824" returned: 0 in 1.738s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0024ad89-4742-46ba-9bf3-4d0340b87b26 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:41 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0024ad89-4742-46ba-9bf3-4d0340b87b26 Jun 24 09:58:41 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fc72d0f5-6c19-4904-bb4f-61c3b2e63763 tempest-VolumesActionsTest-1427458989 None] Acquiring lock "cinder-eecee40f-e2ce-4533-9c02-120deda5da48" by "attach_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:58:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fc72d0f5-6c19-4904-bb4f-61c3b2e63763 tempest-VolumesActionsTest-1427458989 None] Lock "cinder-eecee40f-e2ce-4533-9c02-120deda5da48" acquired by "attach_volume" :: waited 0.024s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:58:41 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-fc72d0f5-6c19-4904-bb4f-61c3b2e63763 tempest-VolumesActionsTest-1427458989 None] Attaching volume eecee40f-e2ce-4533-9c02-120deda5da48 to instance 6dd08adb-dbc0-469e-b0a5-2d200a3a44b3 at mountpoint /dev/vdb on host None. Jun 24 09:58:41 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-fc72d0f5-6c19-4904-bb4f-61c3b2e63763 tempest-VolumesActionsTest-1427458989 None] Attach volume completed successfully. Jun 24 09:58:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fc72d0f5-6c19-4904-bb4f-61c3b2e63763 tempest-VolumesActionsTest-1427458989 None] Lock "cinder-eecee40f-e2ce-4533-9c02-120deda5da48" released by "attach_volume" :: held 0.131s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:58:42 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-343ddeaf-b8cb-44f0-8fe3-b944f309586c tempest-SnapshotDependencyTests-1094195029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.9c73985c-ed33-4d86-a26c-38c711bfd65b" returned: 0 in 1.417s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-343ddeaf-b8cb-44f0-8fe3-b944f309586c tempest-SnapshotDependencyTests-1094195029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:58:42 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a52fce-e339-491a-8eb9-ceff3d253ce1]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:58:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-343ddeaf-b8cb-44f0-8fe3-b944f309586c tempest-SnapshotDependencyTests-1094195029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:42 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0024ad89-4742-46ba-9bf3-4d0340b87b26" returned: 0 in 0.999s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] <== create_volume: return (2802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:58:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.805s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:58:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb500624-87a6-40b6-93a8-70ad6c7e9b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0024ad89-4742-46ba-9bf3-4d0340b87b26', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0381c9c-efff-47f7-add8-02513dd3e555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:58:42 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc Jun 24 09:58:42 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:42 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Volume volume-0024ad89-4742-46ba-9bf3-4d0340b87b26 (0024ad89-4742-46ba-9bf3-4d0340b87b26): created successfully Jun 24 09:58:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0381c9c-efff-47f7-add8-02513dd3e555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:58:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Flow 'volume_create_manager' (b13484c0-f350-4e12-b7c2-6b3d676d3adf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:58:42 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-2fcb79da-0aad-4a6a-981f-6dbad028b98e tempest-VolumesActionsTest-1065443444 None] Created volume successfully. Jun 24 09:58:42 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-626240c6-5545-4289-af7f-91da555d9cbd tempest-VolumesActionsTest-1427458989 None] Acquiring lock "cinder-eecee40f-e2ce-4533-9c02-120deda5da48-detach_volume" by "detach_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:58:42 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-626240c6-5545-4289-af7f-91da555d9cbd tempest-VolumesActionsTest-1427458989 None] Lock "cinder-eecee40f-e2ce-4533-9c02-120deda5da48-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:58:42 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-626240c6-5545-4289-af7f-91da555d9cbd tempest-VolumesActionsTest-1427458989 None] Detaching volume eecee40f-e2ce-4533-9c02-120deda5da48 from instance 6dd08adb-dbc0-469e-b0a5-2d200a3a44b3. Jun 24 09:58:42 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-626240c6-5545-4289-af7f-91da555d9cbd tempest-VolumesActionsTest-1427458989 None] Detach volume completed successfully. Jun 24 09:58:42 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-626240c6-5545-4289-af7f-91da555d9cbd tempest-VolumesActionsTest-1427458989 None] Lock "cinder-eecee40f-e2ce-4533-9c02-120deda5da48-detach_volume" released by "detach_volume" :: held 0.084s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:58:43 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-343ddeaf-b8cb-44f0-8fe3-b944f309586c tempest-SnapshotDependencyTests-1094195029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc" returned: 0 in 0.932s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-343ddeaf-b8cb-44f0-8fe3-b944f309586c tempest-SnapshotDependencyTests-1094195029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.9c73985c-ed33-4d86-a26c-38c711bfd65b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:43 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.9c73985c-ed33-4d86-a26c-38c711bfd65b Jun 24 09:58:43 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:44 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-343ddeaf-b8cb-44f0-8fe3-b944f309586c tempest-SnapshotDependencyTests-1094195029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.9c73985c-ed33-4d86-a26c-38c711bfd65b" returned: 0 in 0.975s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-343ddeaf-b8cb-44f0-8fe3-b944f309586c tempest-SnapshotDependencyTests-1094195029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.9c73985c-ed33-4d86-a26c-38c711bfd65b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:44 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.9c73985c-ed33-4d86-a26c-38c711bfd65b Jun 24 09:58:44 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:44 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-07bfcf1f-18a3-4455-8bb9-e69bb02dd590 tempest-VolumesActionsTest-1065443444 None] Acquiring lock "cinder-0024ad89-4742-46ba-9bf3-4d0340b87b26-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:58:44 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-07bfcf1f-18a3-4455-8bb9-e69bb02dd590 tempest-VolumesActionsTest-1065443444 None] Lock "cinder-0024ad89-4742-46ba-9bf3-4d0340b87b26-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:58:44 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-07bfcf1f-18a3-4455-8bb9-e69bb02dd590 tempest-VolumesActionsTest-1065443444 None] Acquiring lock "cinder-quobyte-0024ad89-4742-46ba-9bf3-4d0340b87b26" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:58:44 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-07bfcf1f-18a3-4455-8bb9-e69bb02dd590 tempest-VolumesActionsTest-1065443444 None] Lock "cinder-quobyte-0024ad89-4742-46ba-9bf3-4d0340b87b26" acquired by "delete_volume" :: waited 0.024s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:58:44 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffbde6e-bb10-428e-92bb-f36d7dca27f7]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:58:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-07bfcf1f-18a3-4455-8bb9-e69bb02dd590 tempest-VolumesActionsTest-1065443444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0024ad89-4742-46ba-9bf3-4d0340b87b26 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:45 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0024ad89-4742-46ba-9bf3-4d0340b87b26 Jun 24 09:58:45 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:45 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-343ddeaf-b8cb-44f0-8fe3-b944f309586c tempest-SnapshotDependencyTests-1094195029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc.9c73985c-ed33-4d86-a26c-38c711bfd65b" returned: 0 in 1.023s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-343ddeaf-b8cb-44f0-8fe3-b944f309586c tempest-SnapshotDependencyTests-1094195029 None] Lock "cinder-quobyte-9c73985c-ed33-4d86-a26c-38c711bfd65b" released by "_delete_snapshot" :: held 4.539s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:58:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-343ddeaf-b8cb-44f0-8fe3-b944f309586c tempest-SnapshotDependencyTests-1094195029 None] Lock "cinder-quobyte-79280d6f-7e90-4965-bf12-b4a7b0c598dc" released by "delete_snapshot" :: held 4.577s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:58:45 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-343ddeaf-b8cb-44f0-8fe3-b944f309586c tempest-SnapshotDependencyTests-1094195029 None] Created reservations ['72876b0a-b4d2-4bac-9679-a9c2edbc6c44', 'e0687c53-f993-425b-bc6f-77da5090d15f', '7315d22b-0bde-47b6-8ff0-49765631d632', 'e509dec2-e427-4a81-8bbb-9621f71274b1'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:58:45 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-343ddeaf-b8cb-44f0-8fe3-b944f309586c tempest-SnapshotDependencyTests-1094195029 None] Delete snapshot completed successfully. Jun 24 09:58:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-343ddeaf-b8cb-44f0-8fe3-b944f309586c tempest-SnapshotDependencyTests-1094195029 None] Lock "cinder-9c73985c-ed33-4d86-a26c-38c711bfd65b-delete_snapshot" released by "delete_snapshot" :: held 4.848s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:58:45 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-07bfcf1f-18a3-4455-8bb9-e69bb02dd590 tempest-VolumesActionsTest-1065443444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0024ad89-4742-46ba-9bf3-4d0340b87b26" returned: 0 in 1.008s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-07bfcf1f-18a3-4455-8bb9-e69bb02dd590 tempest-VolumesActionsTest-1065443444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0024ad89-4742-46ba-9bf3-4d0340b87b26 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:45 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0024ad89-4742-46ba-9bf3-4d0340b87b26 Jun 24 09:58:45 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:46 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-c93c2731-4247-4cbe-b6bf-e544e0806b00 req-ba8ae7b0-4bb6-490a-9a2a-4f203655668b tempest-TestShelveInstance-1737251020 None] Terminate volume connection completed successfully. Jun 24 09:58:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-c93c2731-4247-4cbe-b6bf-e544e0806b00 req-ba8ae7b0-4bb6-490a-9a2a-4f203655668b tempest-TestShelveInstance-1737251020 None] Deleting attachment e6e94dda-5fed-415e-b4f4-318b9ab6860d. {{(pid=93447) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 09:58:46 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-42f759fe-a37b-4802-ad3b-865004ddace9 tempest-SnapshotDependencyTests-1094195029 None] Acquiring lock "cinder-79280d6f-7e90-4965-bf12-b4a7b0c598dc-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:58:46 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-42f759fe-a37b-4802-ad3b-865004ddace9 tempest-SnapshotDependencyTests-1094195029 None] Lock "cinder-79280d6f-7e90-4965-bf12-b4a7b0c598dc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:58:46 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-42f759fe-a37b-4802-ad3b-865004ddace9 tempest-SnapshotDependencyTests-1094195029 None] Acquiring lock "cinder-quobyte-79280d6f-7e90-4965-bf12-b4a7b0c598dc" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:58:46 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-42f759fe-a37b-4802-ad3b-865004ddace9 tempest-SnapshotDependencyTests-1094195029 None] Lock "cinder-quobyte-79280d6f-7e90-4965-bf12-b4a7b0c598dc" acquired by "delete_volume" :: waited 0.026s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:58:46 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6f858f-6372-4667-b60c-801ded369456]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:58:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-42f759fe-a37b-4802-ad3b-865004ddace9 tempest-SnapshotDependencyTests-1094195029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:46 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc Jun 24 09:58:46 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:46 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-07bfcf1f-18a3-4455-8bb9-e69bb02dd590 tempest-VolumesActionsTest-1065443444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0024ad89-4742-46ba-9bf3-4d0340b87b26" returned: 0 in 0.842s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:46 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-07bfcf1f-18a3-4455-8bb9-e69bb02dd590 tempest-VolumesActionsTest-1065443444 None] Lock "cinder-quobyte-0024ad89-4742-46ba-9bf3-4d0340b87b26" released by "delete_volume" :: held 1.902s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:58:46 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-07bfcf1f-18a3-4455-8bb9-e69bb02dd590 tempest-VolumesActionsTest-1065443444 None] Created reservations ['a94c8fc3-cff2-4825-b0a7-fc4465f0a8a0', '0646cb29-cb75-4c4e-9110-5f241bc6691a', 'ba04029a-f2cb-444e-b39e-bf3f7135e551', '36344097-c295-4e07-b08c-a899855baa55'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:58:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-07bfcf1f-18a3-4455-8bb9-e69bb02dd590 tempest-VolumesActionsTest-1065443444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:58:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-07bfcf1f-18a3-4455-8bb9-e69bb02dd590 tempest-VolumesActionsTest-1065443444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:58:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-07bfcf1f-18a3-4455-8bb9-e69bb02dd590 tempest-VolumesActionsTest-1065443444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:58:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-07bfcf1f-18a3-4455-8bb9-e69bb02dd590 tempest-VolumesActionsTest-1065443444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:58:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-07bfcf1f-18a3-4455-8bb9-e69bb02dd590 tempest-VolumesActionsTest-1065443444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:58:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-07bfcf1f-18a3-4455-8bb9-e69bb02dd590 tempest-VolumesActionsTest-1065443444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:46 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:58:46 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:47 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-42f759fe-a37b-4802-ad3b-865004ddace9 tempest-SnapshotDependencyTests-1094195029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc" returned: 0 in 0.952s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-42f759fe-a37b-4802-ad3b-865004ddace9 tempest-SnapshotDependencyTests-1094195029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:47 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc Jun 24 09:58:47 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:47 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-07bfcf1f-18a3-4455-8bb9-e69bb02dd590 tempest-VolumesActionsTest-1065443444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.693s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:47 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-07bfcf1f-18a3-4455-8bb9-e69bb02dd590 tempest-VolumesActionsTest-1065443444 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:58:47 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-07bfcf1f-18a3-4455-8bb9-e69bb02dd590 tempest-VolumesActionsTest-1065443444 None] Deleted volume successfully. Jun 24 09:58:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-07bfcf1f-18a3-4455-8bb9-e69bb02dd590 tempest-VolumesActionsTest-1065443444 None] Lock "cinder-0024ad89-4742-46ba-9bf3-4d0340b87b26-delete_volume" released by "delete_volume" :: held 2.893s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:58:48 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-42f759fe-a37b-4802-ad3b-865004ddace9 tempest-SnapshotDependencyTests-1094195029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79280d6f-7e90-4965-bf12-b4a7b0c598dc" returned: 0 in 0.789s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-42f759fe-a37b-4802-ad3b-865004ddace9 tempest-SnapshotDependencyTests-1094195029 None] Lock "cinder-quobyte-79280d6f-7e90-4965-bf12-b4a7b0c598dc" released by "delete_volume" :: held 1.827s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:58:48 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-42f759fe-a37b-4802-ad3b-865004ddace9 tempest-SnapshotDependencyTests-1094195029 None] Created reservations ['ab115482-a5dc-4faf-af60-744cb7a2b5e6', '09462822-4a59-4b73-b751-0161c3e354be', '00c9d573-6187-4d05-b023-43bd5c57ec7d', 'c0b2e8c4-4704-46a0-b5be-e0cd7347e3d5'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:58:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-42f759fe-a37b-4802-ad3b-865004ddace9 tempest-SnapshotDependencyTests-1094195029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:58:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-42f759fe-a37b-4802-ad3b-865004ddace9 tempest-SnapshotDependencyTests-1094195029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:58:48 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-42f759fe-a37b-4802-ad3b-865004ddace9 tempest-SnapshotDependencyTests-1094195029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:58:48 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-42f759fe-a37b-4802-ad3b-865004ddace9 tempest-SnapshotDependencyTests-1094195029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:58:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-42f759fe-a37b-4802-ad3b-865004ddace9 tempest-SnapshotDependencyTests-1094195029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:58:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-42f759fe-a37b-4802-ad3b-865004ddace9 tempest-SnapshotDependencyTests-1094195029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:48 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:58:48 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-625d331a-bd81-47ab-b09e-995a3de2fd0a tempest-SnapshotDependencyTests-1094195029 None] Acquiring lock "cinder-742d2e95-bd6d-4afd-8180-6fd5b13eb97b-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:58:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-625d331a-bd81-47ab-b09e-995a3de2fd0a tempest-SnapshotDependencyTests-1094195029 None] Lock "cinder-742d2e95-bd6d-4afd-8180-6fd5b13eb97b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:58:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-625d331a-bd81-47ab-b09e-995a3de2fd0a tempest-SnapshotDependencyTests-1094195029 None] Acquiring lock "cinder-quobyte-742d2e95-bd6d-4afd-8180-6fd5b13eb97b" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:58:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-625d331a-bd81-47ab-b09e-995a3de2fd0a tempest-SnapshotDependencyTests-1094195029 None] Lock "cinder-quobyte-742d2e95-bd6d-4afd-8180-6fd5b13eb97b" acquired by "delete_volume" :: waited 0.019s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:58:48 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b8b6e3-e762-4a75-bc82-6a6c21c63ff8]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:58:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-625d331a-bd81-47ab-b09e-995a3de2fd0a tempest-SnapshotDependencyTests-1094195029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-742d2e95-bd6d-4afd-8180-6fd5b13eb97b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:48 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-742d2e95-bd6d-4afd-8180-6fd5b13eb97b Jun 24 09:58:48 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:48 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-42f759fe-a37b-4802-ad3b-865004ddace9 tempest-SnapshotDependencyTests-1094195029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.737s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:48 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-42f759fe-a37b-4802-ad3b-865004ddace9 tempest-SnapshotDependencyTests-1094195029 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:58:48 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-42f759fe-a37b-4802-ad3b-865004ddace9 tempest-SnapshotDependencyTests-1094195029 None] Deleted volume successfully. Jun 24 09:58:49 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-42f759fe-a37b-4802-ad3b-865004ddace9 tempest-SnapshotDependencyTests-1094195029 None] Lock "cinder-79280d6f-7e90-4965-bf12-b4a7b0c598dc-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:58:49 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-625d331a-bd81-47ab-b09e-995a3de2fd0a tempest-SnapshotDependencyTests-1094195029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-742d2e95-bd6d-4afd-8180-6fd5b13eb97b" returned: 0 in 1.150s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-625d331a-bd81-47ab-b09e-995a3de2fd0a tempest-SnapshotDependencyTests-1094195029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-742d2e95-bd6d-4afd-8180-6fd5b13eb97b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:49 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-742d2e95-bd6d-4afd-8180-6fd5b13eb97b Jun 24 09:58:49 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:50 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-625d331a-bd81-47ab-b09e-995a3de2fd0a tempest-SnapshotDependencyTests-1094195029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-742d2e95-bd6d-4afd-8180-6fd5b13eb97b" returned: 0 in 0.748s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-625d331a-bd81-47ab-b09e-995a3de2fd0a tempest-SnapshotDependencyTests-1094195029 None] Lock "cinder-quobyte-742d2e95-bd6d-4afd-8180-6fd5b13eb97b" released by "delete_volume" :: held 1.953s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:58:50 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-625d331a-bd81-47ab-b09e-995a3de2fd0a tempest-SnapshotDependencyTests-1094195029 None] Created reservations ['fe274a89-7841-437f-95a8-1787b93d41e6', '9de67c74-d0e3-4738-8bb2-cd6ec574c542', '6ed752ca-ab4c-49fc-b197-f7daa57d0a0b', '4f488de6-2675-4b8c-82b8-7097713bf533'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:58:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-625d331a-bd81-47ab-b09e-995a3de2fd0a tempest-SnapshotDependencyTests-1094195029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:58:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-625d331a-bd81-47ab-b09e-995a3de2fd0a tempest-SnapshotDependencyTests-1094195029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:58:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-625d331a-bd81-47ab-b09e-995a3de2fd0a tempest-SnapshotDependencyTests-1094195029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:58:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-625d331a-bd81-47ab-b09e-995a3de2fd0a tempest-SnapshotDependencyTests-1094195029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:58:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-625d331a-bd81-47ab-b09e-995a3de2fd0a tempest-SnapshotDependencyTests-1094195029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:58:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-625d331a-bd81-47ab-b09e-995a3de2fd0a tempest-SnapshotDependencyTests-1094195029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:50 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:58:50 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:51 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-625d331a-bd81-47ab-b09e-995a3de2fd0a tempest-SnapshotDependencyTests-1094195029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.841s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:51 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-625d331a-bd81-47ab-b09e-995a3de2fd0a tempest-SnapshotDependencyTests-1094195029 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:58:51 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-625d331a-bd81-47ab-b09e-995a3de2fd0a tempest-SnapshotDependencyTests-1094195029 None] Deleted volume successfully. Jun 24 09:58:51 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-625d331a-bd81-47ab-b09e-995a3de2fd0a tempest-SnapshotDependencyTests-1094195029 None] Lock "cinder-742d2e95-bd6d-4afd-8180-6fd5b13eb97b-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:58:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-87576003-fa43-4146-8d0f-3fa8f809f20b req-d93e3f68-deae-4890-88f0-a0d496178d28 tempest-TestShelveInstance-1737251020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:58:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-87576003-fa43-4146-8d0f-3fa8f809f20b req-d93e3f68-deae-4890-88f0-a0d496178d28 tempest-TestShelveInstance-1737251020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:58:52 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cbcdf0-a9d0-4481-aa03-95d92e449f4a]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:58:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-87576003-fa43-4146-8d0f-3fa8f809f20b req-d93e3f68-deae-4890-88f0-a0d496178d28 tempest-TestShelveInstance-1737251020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:52 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a Jun 24 09:58:52 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-62ad2f32-f689-48e8-8149-754903c5e9a4 tempest-VolumesActionsTest-1427458989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:58:53 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-87576003-fa43-4146-8d0f-3fa8f809f20b req-d93e3f68-deae-4890-88f0-a0d496178d28 tempest-TestShelveInstance-1737251020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a" returned: 0 in 0.950s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-87576003-fa43-4146-8d0f-3fa8f809f20b req-d93e3f68-deae-4890-88f0-a0d496178d28 tempest-TestShelveInstance-1737251020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:53 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a Jun 24 09:58:53 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:54 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-87576003-fa43-4146-8d0f-3fa8f809f20b req-d93e3f68-deae-4890-88f0-a0d496178d28 tempest-TestShelveInstance-1737251020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a" returned: 1 in 0.888s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-87576003-fa43-4146-8d0f-3fa8f809f20b req-d93e3f68-deae-4890-88f0-a0d496178d28 tempest-TestShelveInstance-1737251020 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 09:58:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-87576003-fa43-4146-8d0f-3fa8f809f20b req-d93e3f68-deae-4890-88f0-a0d496178d28 tempest-TestShelveInstance-1737251020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.896s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:58:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-62ad2f32-f689-48e8-8149-754903c5e9a4 tempest-VolumesActionsTest-1427458989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.972s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:58:54 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d51f906-83f5-47f3-9a3d-7ebcf0d0c993]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:58:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-62ad2f32-f689-48e8-8149-754903c5e9a4 tempest-VolumesActionsTest-1427458989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-87576003-fa43-4146-8d0f-3fa8f809f20b req-d93e3f68-deae-4890-88f0-a0d496178d28 tempest-TestShelveInstance-1737251020 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb', 'name': 'volume-1a2bfade-de66-4563-8fdc-0f90f850011a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f20502e4-75f2-42f3-b579-4029b3f5d4c9', 'enforce_multipath': True} {{(pid=93447) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 09:58:54 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-87576003-fa43-4146-8d0f-3fa8f809f20b req-d93e3f68-deae-4890-88f0-a0d496178d28 tempest-TestShelveInstance-1737251020 None] attachment_update completed successfully. Jun 24 09:58:54 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 Jun 24 09:58:54 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:55 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-62ad2f32-f689-48e8-8149-754903c5e9a4 tempest-VolumesActionsTest-1427458989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48" returned: 0 in 0.989s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:55 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb96c3a0-6640-428f-95f2-145898ecf144]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:58:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-62ad2f32-f689-48e8-8149-754903c5e9a4 tempest-VolumesActionsTest-1427458989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:55 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 Jun 24 09:58:55 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:58:56 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Jun 24 09:58:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-62ad2f32-f689-48e8-8149-754903c5e9a4 tempest-VolumesActionsTest-1427458989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48" returned: 0 in 1.087s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:58:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-62ad2f32-f689-48e8-8149-754903c5e9a4 tempest-VolumesActionsTest-1427458989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 /opt/stack/data/cinder/conversion/eecee40f-e2ce-4533-9c02-120deda5da48.temp_image.3330850e-6ea8-456f-b6bd-8db4b10f9a8dclvw0nkk.img {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:58:56 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 /opt/stack/data/cinder/conversion/eecee40f-e2ce-4533-9c02-120deda5da48.temp_image.3330850e-6ea8-456f-b6bd-8db4b10f9a8dclvw0nkk.img Jun 24 09:58:56 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-62ad2f32-f689-48e8-8149-754903c5e9a4 tempest-VolumesActionsTest-1427458989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 /opt/stack/data/cinder/conversion/eecee40f-e2ce-4533-9c02-120deda5da48.temp_image.3330850e-6ea8-456f-b6bd-8db4b10f9a8dclvw0nkk.img" returned: 0 in 6.044s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:02 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[746cc0b5-b936-41d1-bf28-0eeeaf9d970f]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:59:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-62ad2f32-f689-48e8-8149-754903c5e9a4 tempest-VolumesActionsTest-1427458989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:02 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 Jun 24 09:59:02 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:03 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-62ad2f32-f689-48e8-8149-754903c5e9a4 tempest-VolumesActionsTest-1427458989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48" returned: 0 in 1.135s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:03 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-62ad2f32-f689-48e8-8149-754903c5e9a4 tempest-VolumesActionsTest-1427458989 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/conversion/eecee40f-e2ce-4533-9c02-120deda5da48.temp_image.3330850e-6ea8-456f-b6bd-8db4b10f9a8dclvw0nkk.img {{(pid=93447) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 09:59:03 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-62ad2f32-f689-48e8-8149-754903c5e9a4 tempest-VolumesActionsTest-1427458989 None] Converted 1024.00 MB image at 169.33 MB/s Jun 24 09:59:03 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-62ad2f32-f689-48e8-8149-754903c5e9a4 tempest-VolumesActionsTest-1427458989 None] 3330850e-6ea8-456f-b6bd-8db4b10f9a8d was raw, no need to convert to raw {{(pid=93447) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 24 09:59:08 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=75,cinder:UPDATE=73,cinder:INSERT=24,cinder:DELETE=6 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:59:08 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:INSERT=15,cinder:UPDATE=93,cinder:SELECT=74,cinder:DELETE=8 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:59:08 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:59:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Flow 'volume_create_manager' (7fe897c7-264e-4ae0-baf4-547f44004dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:59:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b595929-ff7a-4773-bcba-1400f9c853ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:59:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b595929-ff7a-4773-bcba-1400f9c853ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1242197253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be77a3e-0aa4-4c62-99e2-363f73004654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4267047b824929858c8ddf312d58ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:59:08Z,use_quota=True,user_id='f0440f350e9c4b05822dfafc053c8de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:59:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40359313-bfc5-4c0c-8c3e-6cc32b6ca999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:59:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40359313-bfc5-4c0c-8c3e-6cc32b6ca999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:59:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6403f33c-8244-4f30-a7b4-b01c744fb568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:59:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6403f33c-8244-4f30-a7b4-b01c744fb568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1be77a3e-0aa4-4c62-99e2-363f73004654', 'volume_name': 'volume-1be77a3e-0aa4-4c62-99e2-363f73004654', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:59:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a14971-c50c-4091-9d7a-4d2c3bd88ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:59:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a14971-c50c-4091-9d7a-4d2c3bd88ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:59:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f69683e-c926-4877-a467-da04236f7a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:59:08 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Volume 1be77a3e-0aa4-4c62-99e2-363f73004654: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1be77a3e-0aa4-4c62-99e2-363f73004654', 'volume_size': 1} Jun 24 09:59:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:59:18 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=1 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 09:59:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:59:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:59:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:59:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:59:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:59:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:59:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:25 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:59:25 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-62ad2f32-f689-48e8-8149-754903c5e9a4 tempest-VolumesActionsTest-1427458989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.128s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:59:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-62ad2f32-f689-48e8-8149-754903c5e9a4 tempest-VolumesActionsTest-1427458989 None] Uploaded volume to glance image-id: 3330850e-6ea8-456f-b6bd-8db4b10f9a8d. {{(pid=93447) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 24 09:59:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.277s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:59:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1242197253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be77a3e-0aa4-4c62-99e2-363f73004654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4267047b824929858c8ddf312d58ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:59:08Z,use_quota=True,user_id='f0440f350e9c4b05822dfafc053c8de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:59:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Creating volume 1be77a3e-0aa4-4c62-99e2-363f73004654 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:59:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:59:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:59:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:59:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:59:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:59:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:59:25 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:59:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:25 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-62ad2f32-f689-48e8-8149-754903c5e9a4 tempest-VolumesActionsTest-1427458989 None] Copy volume to image completed successfully. Jun 24 09:59:25 devstack sudo[108545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654 1073741824 Jun 24 09:59:25 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:25 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.675s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:59:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 09:59:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 28 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 09:59:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 09:59:26 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654 1073741824" returned: 0 in 0.835s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:26 devstack sudo[108552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654 Jun 24 09:59:26 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:59:26 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654" returned: 0 in 0.636s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:59:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:59:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.187s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:59:26 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fe75b3-8f30-4ee9-8e37-30b0ffd0afef]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:59:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f69683e-c926-4877-a467-da04236f7a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1be77a3e-0aa4-4c62-99e2-363f73004654', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:59:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db1d690a-ad05-4aa3-a794-5499d835a69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:59:26 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Volume volume-1be77a3e-0aa4-4c62-99e2-363f73004654 (1be77a3e-0aa4-4c62-99e2-363f73004654): created successfully Jun 24 09:59:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db1d690a-ad05-4aa3-a794-5499d835a69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:59:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Flow 'volume_create_manager' (7fe897c7-264e-4ae0-baf4-547f44004dc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:59:26 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-d02b0f76-9fca-44c5-851b-b4fc4d46c0c1 tempest-SnapshotMetadataTestJSON-1458379419 None] Created volume successfully. Jun 24 09:59:27 devstack sudo[108555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 Jun 24 09:59:27 devstack sudo[108555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-dd5ca59b-cbc8-4d3f-bbc2-8874df45f819 tempest-SnapshotMetadataTestJSON-1458379419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:59:27 devstack sudo[108555]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48" returned: 0 in 0.752s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:27 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d031e7fa-4be9-4d86-9cef-b5819aaf161c]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:59:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:27 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 Jun 24 09:59:27 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:28 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48" returned: 0 in 0.743s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 /opt/stack/data/cinder/conversion/eecee40f-e2ce-4533-9c02-120deda5da48.temp_image.40b8f4cc-a59f-4eb5-b837-e6a6a6e1c0aa9p2a3n5k.img {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:28 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 /opt/stack/data/cinder/conversion/eecee40f-e2ce-4533-9c02-120deda5da48.temp_image.40b8f4cc-a59f-4eb5-b837-e6a6a6e1c0aa9p2a3n5k.img Jun 24 09:59:28 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:32 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 /opt/stack/data/cinder/conversion/eecee40f-e2ce-4533-9c02-120deda5da48.temp_image.40b8f4cc-a59f-4eb5-b837-e6a6a6e1c0aa9p2a3n5k.img" returned: 0 in 4.536s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:32 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a347d8-7af5-4717-8e37-f9dbeb5d8fe1]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:59:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:33 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 Jun 24 09:59:33 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:33 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48" returned: 0 in 0.911s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:33 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48, size 1024.00 MB, duration 4.54 sec, destination /opt/stack/data/cinder/conversion/eecee40f-e2ce-4533-9c02-120deda5da48.temp_image.40b8f4cc-a59f-4eb5-b837-e6a6a6e1c0aa9p2a3n5k.img {{(pid=93447) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 09:59:33 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] Converted 1024.00 MB image at 225.68 MB/s Jun 24 09:59:33 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] 40b8f4cc-a59f-4eb5-b837-e6a6a6e1c0aa was raw, converting to qcow2 {{(pid=93447) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 24 09:59:33 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[814b7cc3-0d38-4830-87f0-6b2640b98ae0]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:59:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/eecee40f-e2ce-4533-9c02-120deda5da48.temp_image.40b8f4cc-a59f-4eb5-b837-e6a6a6e1c0aa9p2a3n5k.img {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:34 devstack sudo[108585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/eecee40f-e2ce-4533-9c02-120deda5da48.temp_image.40b8f4cc-a59f-4eb5-b837-e6a6a6e1c0aa9p2a3n5k.img Jun 24 09:59:34 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:34 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/eecee40f-e2ce-4533-9c02-120deda5da48.temp_image.40b8f4cc-a59f-4eb5-b837-e6a6a6e1c0aa9p2a3n5k.img" returned: 0 in 0.726s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eecee40f-e2ce-4533-9c02-120deda5da48.temp_image.40b8f4cc-a59f-4eb5-b837-e6a6a6e1c0aa9p2a3n5k.img {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:34 devstack sudo[108589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eecee40f-e2ce-4533-9c02-120deda5da48.temp_image.40b8f4cc-a59f-4eb5-b837-e6a6a6e1c0aa9p2a3n5k.img Jun 24 09:59:34 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:35 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eecee40f-e2ce-4533-9c02-120deda5da48.temp_image.40b8f4cc-a59f-4eb5-b837-e6a6a6e1c0aa9p2a3n5k.img" returned: 1 in 0.749s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eecee40f-e2ce-4533-9c02-120deda5da48.temp_image.40b8f4cc-a59f-4eb5-b837-e6a6a6e1c0aa9p2a3n5k.img' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 09:59:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/eecee40f-e2ce-4533-9c02-120deda5da48.temp_image.40b8f4cc-a59f-4eb5-b837-e6a6a6e1c0aa9p2a3n5k.img /opt/stack/data/cinder/conversion/vol_upload_fpnk2l7a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:35 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/eecee40f-e2ce-4533-9c02-120deda5da48.temp_image.40b8f4cc-a59f-4eb5-b837-e6a6a6e1c0aa9p2a3n5k.img /opt/stack/data/cinder/conversion/vol_upload_fpnk2l7a Jun 24 09:59:35 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:36 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/eecee40f-e2ce-4533-9c02-120deda5da48.temp_image.40b8f4cc-a59f-4eb5-b837-e6a6a6e1c0aa9p2a3n5k.img /opt/stack/data/cinder/conversion/vol_upload_fpnk2l7a" returned: 0 in 0.647s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:36 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] Image conversion details: src /opt/stack/data/cinder/conversion/eecee40f-e2ce-4533-9c02-120deda5da48.temp_image.40b8f4cc-a59f-4eb5-b837-e6a6a6e1c0aa9p2a3n5k.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_fpnk2l7a {{(pid=93447) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 09:59:36 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 24 09:59:36 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1c1376-aea6-484e-aa11-6769cf657040]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:59:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fpnk2l7a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:36 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fpnk2l7a Jun 24 09:59:36 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:36 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_fpnk2l7a" returned: 0 in 0.705s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.062s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:59:37 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] Uploaded volume to glance image-id: 40b8f4cc-a59f-4eb5-b837-e6a6a6e1c0aa. {{(pid=93447) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 24 09:59:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-dd5ca59b-cbc8-4d3f-bbc2-8874df45f819 tempest-SnapshotMetadataTestJSON-1458379419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.363s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:59:38 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-dd5ca59b-cbc8-4d3f-bbc2-8874df45f819 tempest-SnapshotMetadataTestJSON-1458379419 None] Creating offline snapshot f952b86a-85c8-464c-8b0c-fa5cb36c791f of volume 1be77a3e-0aa4-4c62-99e2-363f73004654 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 09:59:38 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-13b581e7-4cf7-43b4-bdb8-db05ce97c508 tempest-VolumesActionsTest-1427458989 None] Copy volume to image completed successfully. Jun 24 09:59:38 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f3e400-6062-44ff-a3d2-c86d093e16ab]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:59:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dd5ca59b-cbc8-4d3f-bbc2-8874df45f819 tempest-SnapshotMetadataTestJSON-1458379419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:38 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654 Jun 24 09:59:38 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:38 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:38 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9d0a2e83-e15e-4519-9199-892e77778c41 tempest-VolumesActionsTest-1427458989 None] Acquiring lock "cinder-eecee40f-e2ce-4533-9c02-120deda5da48-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:59:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dd5ca59b-cbc8-4d3f-bbc2-8874df45f819 tempest-SnapshotMetadataTestJSON-1458379419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654" returned: 0 in 0.798s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dd5ca59b-cbc8-4d3f-bbc2-8874df45f819 tempest-SnapshotMetadataTestJSON-1458379419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.f952b86a-85c8-464c-8b0c-fa5cb36c791f 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:38 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9d0a2e83-e15e-4519-9199-892e77778c41 tempest-VolumesActionsTest-1427458989 None] Lock "cinder-eecee40f-e2ce-4533-9c02-120deda5da48-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:59:38 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.f952b86a-85c8-464c-8b0c-fa5cb36c791f 1G Jun 24 09:59:38 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:38 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9d0a2e83-e15e-4519-9199-892e77778c41 tempest-VolumesActionsTest-1427458989 None] Acquiring lock "cinder-quobyte-eecee40f-e2ce-4533-9c02-120deda5da48" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:59:38 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9d0a2e83-e15e-4519-9199-892e77778c41 tempest-VolumesActionsTest-1427458989 None] Lock "cinder-quobyte-eecee40f-e2ce-4533-9c02-120deda5da48" acquired by "delete_volume" :: waited 0.016s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:59:38 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cb0e8d-eab0-46b9-b37d-74ab90a5c96a]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:59:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9d0a2e83-e15e-4519-9199-892e77778c41 tempest-VolumesActionsTest-1427458989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:39 devstack sudo[108612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 Jun 24 09:59:39 devstack sudo[108612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:39 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dd5ca59b-cbc8-4d3f-bbc2-8874df45f819 tempest-SnapshotMetadataTestJSON-1458379419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.f952b86a-85c8-464c-8b0c-fa5cb36c791f 1G" returned: 0 in 0.825s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dd5ca59b-cbc8-4d3f-bbc2-8874df45f819 tempest-SnapshotMetadataTestJSON-1458379419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1be77a3e-0aa4-4c62-99e2-363f73004654 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.f952b86a-85c8-464c-8b0c-fa5cb36c791f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:39 devstack sudo[108621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1be77a3e-0aa4-4c62-99e2-363f73004654 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.f952b86a-85c8-464c-8b0c-fa5cb36c791f Jun 24 09:59:39 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:39 devstack sudo[108612]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9d0a2e83-e15e-4519-9199-892e77778c41 tempest-VolumesActionsTest-1427458989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48" returned: 0 in 0.796s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9d0a2e83-e15e-4519-9199-892e77778c41 tempest-VolumesActionsTest-1427458989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:39 devstack sudo[108623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48 Jun 24 09:59:39 devstack sudo[108623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:40 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dd5ca59b-cbc8-4d3f-bbc2-8874df45f819 tempest-SnapshotMetadataTestJSON-1458379419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1be77a3e-0aa4-4c62-99e2-363f73004654 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.f952b86a-85c8-464c-8b0c-fa5cb36c791f" returned: 0 in 0.684s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:40 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-dd5ca59b-cbc8-4d3f-bbc2-8874df45f819 tempest-SnapshotMetadataTestJSON-1458379419 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.f952b86a-85c8-464c-8b0c-fa5cb36c791f is being set with open permissions: ugo+rw Jun 24 09:59:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dd5ca59b-cbc8-4d3f-bbc2-8874df45f819 tempest-SnapshotMetadataTestJSON-1458379419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.f952b86a-85c8-464c-8b0c-fa5cb36c791f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:40 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.f952b86a-85c8-464c-8b0c-fa5cb36c791f Jun 24 09:59:40 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:40 devstack sudo[108623]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9d0a2e83-e15e-4519-9199-892e77778c41 tempest-VolumesActionsTest-1427458989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-eecee40f-e2ce-4533-9c02-120deda5da48" returned: 0 in 0.688s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9d0a2e83-e15e-4519-9199-892e77778c41 tempest-VolumesActionsTest-1427458989 None] Lock "cinder-quobyte-eecee40f-e2ce-4533-9c02-120deda5da48" released by "delete_volume" :: held 1.528s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:59:40 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-9d0a2e83-e15e-4519-9199-892e77778c41 tempest-VolumesActionsTest-1427458989 None] Created reservations ['1e2b7861-1d83-47c0-bbde-62d6cbf59e7b', '3c94b8e7-1ad6-45ab-9b40-0914f43a1350', '5dde8682-90ba-4613-8f7e-a1eb641749f5', 'e36be77d-72a5-469f-9300-bdc464c44445'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:59:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9d0a2e83-e15e-4519-9199-892e77778c41 tempest-VolumesActionsTest-1427458989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:59:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9d0a2e83-e15e-4519-9199-892e77778c41 tempest-VolumesActionsTest-1427458989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:59:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9d0a2e83-e15e-4519-9199-892e77778c41 tempest-VolumesActionsTest-1427458989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:59:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9d0a2e83-e15e-4519-9199-892e77778c41 tempest-VolumesActionsTest-1427458989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:59:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9d0a2e83-e15e-4519-9199-892e77778c41 tempest-VolumesActionsTest-1427458989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:59:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9d0a2e83-e15e-4519-9199-892e77778c41 tempest-VolumesActionsTest-1427458989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:40 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:59:40 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:41 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dd5ca59b-cbc8-4d3f-bbc2-8874df45f819 tempest-SnapshotMetadataTestJSON-1458379419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.f952b86a-85c8-464c-8b0c-fa5cb36c791f" returned: 0 in 0.679s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dd5ca59b-cbc8-4d3f-bbc2-8874df45f819 tempest-SnapshotMetadataTestJSON-1458379419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:41 devstack sudo[108635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.info Jun 24 09:59:41 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:41 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9d0a2e83-e15e-4519-9199-892e77778c41 tempest-VolumesActionsTest-1427458989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.658s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:41 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-9d0a2e83-e15e-4519-9199-892e77778c41 tempest-VolumesActionsTest-1427458989 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:59:41 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-9d0a2e83-e15e-4519-9199-892e77778c41 tempest-VolumesActionsTest-1427458989 None] Deleted volume successfully. Jun 24 09:59:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9d0a2e83-e15e-4519-9199-892e77778c41 tempest-VolumesActionsTest-1427458989 None] Lock "cinder-eecee40f-e2ce-4533-9c02-120deda5da48-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:59:41 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dd5ca59b-cbc8-4d3f-bbc2-8874df45f819 tempest-SnapshotMetadataTestJSON-1458379419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.info" returned: 0 in 0.761s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:41 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-dd5ca59b-cbc8-4d3f-bbc2-8874df45f819 tempest-SnapshotMetadataTestJSON-1458379419 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.info is being set with open permissions: ugo+rw Jun 24 09:59:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dd5ca59b-cbc8-4d3f-bbc2-8874df45f819 tempest-SnapshotMetadataTestJSON-1458379419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:41 devstack sudo[108641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.info Jun 24 09:59:41 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:42 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dd5ca59b-cbc8-4d3f-bbc2-8874df45f819 tempest-SnapshotMetadataTestJSON-1458379419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.info" returned: 0 in 0.689s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-dd5ca59b-cbc8-4d3f-bbc2-8874df45f819 tempest-SnapshotMetadataTestJSON-1458379419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.534s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:59:42 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-dd5ca59b-cbc8-4d3f-bbc2-8874df45f819 tempest-SnapshotMetadataTestJSON-1458379419 None] Create snapshot completed successfully Jun 24 09:59:44 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2343df4e-b5ee-41d4-a877-a6921470fe35 tempest-SnapshotMetadataTestJSON-1458379419 None] Acquiring lock "cinder-f952b86a-85c8-464c-8b0c-fa5cb36c791f-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:59:44 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2343df4e-b5ee-41d4-a877-a6921470fe35 tempest-SnapshotMetadataTestJSON-1458379419 None] Lock "cinder-f952b86a-85c8-464c-8b0c-fa5cb36c791f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:59:44 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2343df4e-b5ee-41d4-a877-a6921470fe35 tempest-SnapshotMetadataTestJSON-1458379419 None] Acquiring lock "cinder-quobyte-1be77a3e-0aa4-4c62-99e2-363f73004654" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:59:44 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2343df4e-b5ee-41d4-a877-a6921470fe35 tempest-SnapshotMetadataTestJSON-1458379419 None] Lock "cinder-quobyte-1be77a3e-0aa4-4c62-99e2-363f73004654" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:59:44 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2343df4e-b5ee-41d4-a877-a6921470fe35 tempest-SnapshotMetadataTestJSON-1458379419 None] Acquiring lock "cinder-quobyte-f952b86a-85c8-464c-8b0c-fa5cb36c791f" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:59:44 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2343df4e-b5ee-41d4-a877-a6921470fe35 tempest-SnapshotMetadataTestJSON-1458379419 None] Lock "cinder-quobyte-f952b86a-85c8-464c-8b0c-fa5cb36c791f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:59:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-2343df4e-b5ee-41d4-a877-a6921470fe35 tempest-SnapshotMetadataTestJSON-1458379419 None] Deleting offline snapshot f952b86a-85c8-464c-8b0c-fa5cb36c791f of volume 1be77a3e-0aa4-4c62-99e2-363f73004654 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 09:59:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-2343df4e-b5ee-41d4-a877-a6921470fe35 tempest-SnapshotMetadataTestJSON-1458379419 None] snapshot_file for this snap is: volume-1be77a3e-0aa4-4c62-99e2-363f73004654.f952b86a-85c8-464c-8b0c-fa5cb36c791f {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 09:59:44 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5949f6ff-b06b-44f9-bcbe-cbc63c59a3cf]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:59:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2343df4e-b5ee-41d4-a877-a6921470fe35 tempest-SnapshotMetadataTestJSON-1458379419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.f952b86a-85c8-464c-8b0c-fa5cb36c791f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:44 devstack sudo[108645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.f952b86a-85c8-464c-8b0c-fa5cb36c791f Jun 24 09:59:44 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:44 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2343df4e-b5ee-41d4-a877-a6921470fe35 tempest-SnapshotMetadataTestJSON-1458379419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.f952b86a-85c8-464c-8b0c-fa5cb36c791f" returned: 0 in 0.791s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-2343df4e-b5ee-41d4-a877-a6921470fe35 tempest-SnapshotMetadataTestJSON-1458379419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1be77a3e-0aa4-4c62-99e2-363f73004654(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 09:59:45 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c3a29b-ef78-4675-a66e-7362125a370d]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:59:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2343df4e-b5ee-41d4-a877-a6921470fe35 tempest-SnapshotMetadataTestJSON-1458379419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:45 devstack sudo[108651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654 Jun 24 09:59:45 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:45 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2343df4e-b5ee-41d4-a877-a6921470fe35 tempest-SnapshotMetadataTestJSON-1458379419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654" returned: 0 in 0.822s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2343df4e-b5ee-41d4-a877-a6921470fe35 tempest-SnapshotMetadataTestJSON-1458379419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.f952b86a-85c8-464c-8b0c-fa5cb36c791f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:45 devstack sudo[108656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.f952b86a-85c8-464c-8b0c-fa5cb36c791f Jun 24 09:59:45 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:46 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2343df4e-b5ee-41d4-a877-a6921470fe35 tempest-SnapshotMetadataTestJSON-1458379419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.f952b86a-85c8-464c-8b0c-fa5cb36c791f" returned: 0 in 0.771s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2343df4e-b5ee-41d4-a877-a6921470fe35 tempest-SnapshotMetadataTestJSON-1458379419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.f952b86a-85c8-464c-8b0c-fa5cb36c791f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:46 devstack sudo[108662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.f952b86a-85c8-464c-8b0c-fa5cb36c791f Jun 24 09:59:46 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:47 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2343df4e-b5ee-41d4-a877-a6921470fe35 tempest-SnapshotMetadataTestJSON-1458379419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654.f952b86a-85c8-464c-8b0c-fa5cb36c791f" returned: 0 in 0.693s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2343df4e-b5ee-41d4-a877-a6921470fe35 tempest-SnapshotMetadataTestJSON-1458379419 None] Lock "cinder-quobyte-f952b86a-85c8-464c-8b0c-fa5cb36c791f" released by "_delete_snapshot" :: held 3.196s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:59:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2343df4e-b5ee-41d4-a877-a6921470fe35 tempest-SnapshotMetadataTestJSON-1458379419 None] Lock "cinder-quobyte-1be77a3e-0aa4-4c62-99e2-363f73004654" released by "delete_snapshot" :: held 3.229s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:59:47 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-2343df4e-b5ee-41d4-a877-a6921470fe35 tempest-SnapshotMetadataTestJSON-1458379419 None] Created reservations ['615a9741-a4c2-45c3-b690-7f35b8ef4890', '69f2d81b-0f62-41c8-81e4-0ecd01cc689d', '197aa875-601c-4122-8881-8ef39fefc121', '9f964862-66ca-46aa-85ac-36a7a2c4d7f0'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:59:47 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-2343df4e-b5ee-41d4-a877-a6921470fe35 tempest-SnapshotMetadataTestJSON-1458379419 None] Delete snapshot completed successfully. Jun 24 09:59:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2343df4e-b5ee-41d4-a877-a6921470fe35 tempest-SnapshotMetadataTestJSON-1458379419 None] Lock "cinder-f952b86a-85c8-464c-8b0c-fa5cb36c791f-delete_snapshot" released by "delete_snapshot" :: held 3.388s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:59:47 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:59:47 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Flow 'volume_create_manager' (fea0f45a-d412-4121-9dc8-9febe7d5d96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:59:47 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a22e25c7-2915-4f7d-87d8-efa118af4d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:59:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a22e25c7-2915-4f7d-87d8-efa118af4d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1912171419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5088d5-6636-414b-b17a-35fc7d43e7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c290557741e54b8f85872674f8e99055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:59:48Z,use_quota=True,user_id='366a75d7c42c428aa403ce02040e2247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:59:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a344fa8-ea21-415f-9c2a-4cb6b6941512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:59:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a344fa8-ea21-415f-9c2a-4cb6b6941512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:59:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f1f8fd-ec43-4d46-b4b6-165bb98b608b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:59:48 devstack cinder-volume[93447]: DEBUG cinder.image.glance [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Creating Keystone auth plugin from conf {{(pid=93447) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 09:59:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f1f8fd-ec43-4d46-b4b6-165bb98b608b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ff5088d5-6636-414b-b17a-35fc7d43e7c7', 'volume_name': 'volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7', 'volume_size': 1, 'image_id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48394558c0ae48f385c046476f3b062e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'created_at': datetime.datetime(2026, 6, 24, 7, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 7, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:59:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cccc3790-3313-43ff-bb54-30e0741d22e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:59:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cccc3790-3313-43ff-bb54-30e0741d22e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:59:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9b8be2-f95d-4639-b8ab-bef2d7ef260a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:59:48 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Volume ff5088d5-6636-414b-b17a-35fc7d43e7c7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7', 'volume_size': 1, 'image_id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48394558c0ae48f385c046476f3b062e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'created_at': datetime.datetime(2026, 6, 24, 7, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 7, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 24 09:59:48 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Trying to clone ff5088d5-6636-414b-b17a-35fc7d43e7c7 from image cd371dd7-fca0-4345-9276-7b2a9b23d2c0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'metadata': {}}]). {{(pid=93447) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 09:59:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3b503c0a-6eeb-451f-a903-334e782789d5 tempest-SnapshotMetadataTestJSON-1458379419 None] Acquiring lock "cinder-1be77a3e-0aa4-4c62-99e2-363f73004654-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:59:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3b503c0a-6eeb-451f-a903-334e782789d5 tempest-SnapshotMetadataTestJSON-1458379419 None] Lock "cinder-1be77a3e-0aa4-4c62-99e2-363f73004654-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:59:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3b503c0a-6eeb-451f-a903-334e782789d5 tempest-SnapshotMetadataTestJSON-1458379419 None] Acquiring lock "cinder-quobyte-1be77a3e-0aa4-4c62-99e2-363f73004654" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:59:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3b503c0a-6eeb-451f-a903-334e782789d5 tempest-SnapshotMetadataTestJSON-1458379419 None] Lock "cinder-quobyte-1be77a3e-0aa4-4c62-99e2-363f73004654" acquired by "delete_volume" :: waited 0.026s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:59:48 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[716cafce-cd6c-40a0-abe8-5c72cd2a5ef0]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:59:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3b503c0a-6eeb-451f-a903-334e782789d5 tempest-SnapshotMetadataTestJSON-1458379419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:48 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_fk39wohmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 09:59:48 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Image download 20.69 MB at 20.69 MB/s Jun 24 09:59:48 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf90a12-5057-4f26-8317-1dcdc19de19e]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:59:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_fk39wohmdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:48 devstack sudo[108672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654 Jun 24 09:59:48 devstack sudo[108672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:48 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_fk39wohmdevstack@QuobyteHD Jun 24 09:59:48 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:49 devstack sudo[108672]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3b503c0a-6eeb-451f-a903-334e782789d5 tempest-SnapshotMetadataTestJSON-1458379419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654" returned: 0 in 0.982s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3b503c0a-6eeb-451f-a903-334e782789d5 tempest-SnapshotMetadataTestJSON-1458379419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:49 devstack sudo[108724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654 Jun 24 09:59:49 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:49 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_fk39wohmdevstack@QuobyteHD" returned: 0 in 0.984s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:49 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Temporary image cd371dd7-fca0-4345-9276-7b2a9b23d2c0 is fetched for user 366a75d7c42c428aa403ce02040e2247. {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 09:59:49 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4bd7f8-42cd-4450-9601-757de5cca62f]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:59:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_fk39wohmdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:49 devstack sudo[108726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_fk39wohmdevstack@QuobyteHD Jun 24 09:59:49 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:50 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3b503c0a-6eeb-451f-a903-334e782789d5 tempest-SnapshotMetadataTestJSON-1458379419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1be77a3e-0aa4-4c62-99e2-363f73004654" returned: 0 in 0.776s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3b503c0a-6eeb-451f-a903-334e782789d5 tempest-SnapshotMetadataTestJSON-1458379419 None] Lock "cinder-quobyte-1be77a3e-0aa4-4c62-99e2-363f73004654" released by "delete_volume" :: held 1.820s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:59:50 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-3b503c0a-6eeb-451f-a903-334e782789d5 tempest-SnapshotMetadataTestJSON-1458379419 None] Created reservations ['e5953d7a-be93-4801-ac6c-888404573c43', '04c49f3c-ee8a-4b74-a095-ed8c13832d7e', '6013e5f5-67a5-40ed-865a-0b6beb01dfcf', 'eb4c2f04-b571-4fb0-9c60-5d5e6485c26e'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:59:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3b503c0a-6eeb-451f-a903-334e782789d5 tempest-SnapshotMetadataTestJSON-1458379419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:59:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3b503c0a-6eeb-451f-a903-334e782789d5 tempest-SnapshotMetadataTestJSON-1458379419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:59:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3b503c0a-6eeb-451f-a903-334e782789d5 tempest-SnapshotMetadataTestJSON-1458379419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:59:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3b503c0a-6eeb-451f-a903-334e782789d5 tempest-SnapshotMetadataTestJSON-1458379419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:59:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3b503c0a-6eeb-451f-a903-334e782789d5 tempest-SnapshotMetadataTestJSON-1458379419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:59:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3b503c0a-6eeb-451f-a903-334e782789d5 tempest-SnapshotMetadataTestJSON-1458379419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:50 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:59:50 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:50 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_fk39wohmdevstack@QuobyteHD" returned: 0 in 0.833s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:59:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:59:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1912171419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5088d5-6636-414b-b17a-35fc7d43e7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c290557741e54b8f85872674f8e99055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:59:48Z,use_quota=True,user_id='366a75d7c42c428aa403ce02040e2247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:59:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Creating volume ff5088d5-6636-414b-b17a-35fc7d43e7c7 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:59:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:59:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:59:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:59:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:59:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:59:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:59:50 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:59:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:50 devstack sudo[108736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 1073741824 Jun 24 09:59:50 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:51 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3b503c0a-6eeb-451f-a903-334e782789d5 tempest-SnapshotMetadataTestJSON-1458379419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.817s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:51 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-3b503c0a-6eeb-451f-a903-334e782789d5 tempest-SnapshotMetadataTestJSON-1458379419 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:59:51 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-3b503c0a-6eeb-451f-a903-334e782789d5 tempest-SnapshotMetadataTestJSON-1458379419 None] Deleted volume successfully. Jun 24 09:59:51 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3b503c0a-6eeb-451f-a903-334e782789d5 tempest-SnapshotMetadataTestJSON-1458379419 None] Lock "cinder-1be77a3e-0aa4-4c62-99e2-363f73004654-delete_volume" released by "delete_volume" :: held 2.935s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:59:51 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 1073741824" returned: 0 in 1.168s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:51 devstack sudo[108747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 Jun 24 09:59:51 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:52 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-785e4bc8-dbae-4fac-9e2b-d9b4738907cd tempest-TestShelveInstance-1737251020 None] Terminate volume connection completed successfully. Jun 24 09:59:52 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-785e4bc8-dbae-4fac-9e2b-d9b4738907cd tempest-TestShelveInstance-1737251020 None] Deleting attachment f20502e4-75f2-42f3-b579-4029b3f5d4c9. {{(pid=93447) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 09:59:52 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7" returned: 0 in 0.781s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:52 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:59:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:59:52 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Attempting download of cd371dd7-fca0-4345-9276-7b2a9b23d2c0 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'metadata': {}}])) to volume ff5088d5-6636-414b-b17a-35fc7d43e7c7. {{(pid=93447) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 09:59:52 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[69783374-bae7-4aa5-9507-c39ad2a1076b]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:59:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_h6zz8v80 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:52 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_h6zz8v80 Jun 24 09:59:52 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:53 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-e3fa81cb-98aa-47d8-b36a-57f17f2efb11 tempest-TestShelveInstance-1737251020 None] Acquiring lock "cinder-1a2bfade-de66-4563-8fdc-0f90f850011a-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:59:53 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-e3fa81cb-98aa-47d8-b36a-57f17f2efb11 tempest-TestShelveInstance-1737251020 None] Lock "cinder-1a2bfade-de66-4563-8fdc-0f90f850011a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:59:53 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-e3fa81cb-98aa-47d8-b36a-57f17f2efb11 tempest-TestShelveInstance-1737251020 None] Acquiring lock "cinder-quobyte-1a2bfade-de66-4563-8fdc-0f90f850011a" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 09:59:53 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-e3fa81cb-98aa-47d8-b36a-57f17f2efb11 tempest-TestShelveInstance-1737251020 None] Lock "cinder-quobyte-1a2bfade-de66-4563-8fdc-0f90f850011a" acquired by "delete_volume" :: waited 0.016s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 09:59:53 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d07ed6-e4df-4beb-9b2d-b4966bd7de85]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:59:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-e3fa81cb-98aa-47d8-b36a-57f17f2efb11 tempest-TestShelveInstance-1737251020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:53 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_h6zz8v80" returned: 0 in 0.794s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_h6zz8v80 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:53 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a Jun 24 09:59:53 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:53 devstack sudo[108756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_h6zz8v80 Jun 24 09:59:53 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:54 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_h6zz8v80" returned: 1 in 0.822s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_h6zz8v80' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 09:59:54 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ed5d2d-0190-455c-99fa-06270280d2c9]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:59:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_fk39wohmdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:54 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-e3fa81cb-98aa-47d8-b36a-57f17f2efb11 tempest-TestShelveInstance-1737251020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a" returned: 0 in 0.960s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-e3fa81cb-98aa-47d8-b36a-57f17f2efb11 tempest-TestShelveInstance-1737251020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:54 devstack sudo[108764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_fk39wohmdevstack@QuobyteHD Jun 24 09:59:54 devstack sudo[108764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:54 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a Jun 24 09:59:54 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:55 devstack sudo[108764]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_fk39wohmdevstack@QuobyteHD" returned: 0 in 0.825s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:55 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] cd371dd7-fca0-4345-9276-7b2a9b23d2c0 was qcow2, converting to raw {{(pid=93447) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 09:59:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_fk39wohmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:55 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-e3fa81cb-98aa-47d8-b36a-57f17f2efb11 tempest-TestShelveInstance-1737251020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a" returned: 1 in 0.849s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-e3fa81cb-98aa-47d8-b36a-57f17f2efb11 tempest-TestShelveInstance-1737251020 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 09:59:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-e3fa81cb-98aa-47d8-b36a-57f17f2efb11 tempest-TestShelveInstance-1737251020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:55 devstack sudo[108774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_fk39wohmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 Jun 24 09:59:55 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:55 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a Jun 24 09:59:55 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:55 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-e3fa81cb-98aa-47d8-b36a-57f17f2efb11 tempest-TestShelveInstance-1737251020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1a2bfade-de66-4563-8fdc-0f90f850011a" returned: 0 in 0.715s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:55 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-e3fa81cb-98aa-47d8-b36a-57f17f2efb11 tempest-TestShelveInstance-1737251020 None] Lock "cinder-quobyte-1a2bfade-de66-4563-8fdc-0f90f850011a" released by "delete_volume" :: held 2.615s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:59:56 devstack cinder-volume[93447]: DEBUG cinder.quota [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-e3fa81cb-98aa-47d8-b36a-57f17f2efb11 tempest-TestShelveInstance-1737251020 None] Created reservations ['501c4f34-f2b5-4846-96e1-ea1203a9cb26', '98456de8-3f9d-4ff6-9abb-be13836ff229', 'aa186357-08c1-4145-8a84-d97181bb3587', '1c999bc1-c7bb-41cb-8c1c-3ba34c6d0de3'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 09:59:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-e3fa81cb-98aa-47d8-b36a-57f17f2efb11 tempest-TestShelveInstance-1737251020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:59:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-e3fa81cb-98aa-47d8-b36a-57f17f2efb11 tempest-TestShelveInstance-1737251020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:59:56 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-e3fa81cb-98aa-47d8-b36a-57f17f2efb11 tempest-TestShelveInstance-1737251020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:59:56 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-e3fa81cb-98aa-47d8-b36a-57f17f2efb11 tempest-TestShelveInstance-1737251020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:59:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-e3fa81cb-98aa-47d8-b36a-57f17f2efb11 tempest-TestShelveInstance-1737251020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:59:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-e3fa81cb-98aa-47d8-b36a-57f17f2efb11 tempest-TestShelveInstance-1737251020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:56 devstack sudo[108786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 09:59:56 devstack sudo[108786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:56 devstack sudo[108786]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-e3fa81cb-98aa-47d8-b36a-57f17f2efb11 tempest-TestShelveInstance-1737251020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.799s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:56 devstack cinder-volume[93447]: DEBUG cinder.manager [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-e3fa81cb-98aa-47d8-b36a-57f17f2efb11 tempest-TestShelveInstance-1737251020 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 09:59:56 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-e3fa81cb-98aa-47d8-b36a-57f17f2efb11 tempest-TestShelveInstance-1737251020 None] Deleted volume successfully. Jun 24 09:59:56 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 09:59:56 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Flow 'volume_create_manager' (d3379c4f-f827-454c-95fd-92d164aace49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:59:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8e8955-136e-47f9-857f-daec307283dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:59:57 devstack cinder-volume[93447]: DEBUG cinder.coordination [req-077f5e9d-ef3a-4e18-bb1e-01927147738b req-e3fa81cb-98aa-47d8-b36a-57f17f2efb11 tempest-TestShelveInstance-1737251020 None] Lock "cinder-1a2bfade-de66-4563-8fdc-0f90f850011a-delete_volume" released by "delete_volume" :: held 3.778s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 09:59:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8e8955-136e-47f9-857f-daec307283dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-453887569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d74f1d76-8649-425c-9df0-34439fe1026b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c96dbc2789b244e1b675855ac7ab30df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:59:57Z,use_quota=True,user_id='df405c3b00834038a0a6f3c844b3ccdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:59:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77513893-be95-4c59-8176-c1427c91b13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:59:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77513893-be95-4c59-8176-c1427c91b13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:59:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1942107d-6a7e-4df9-9ea3-edc1a4b45601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:59:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1942107d-6a7e-4df9-9ea3-edc1a4b45601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd74f1d76-8649-425c-9df0-34439fe1026b', 'volume_name': 'volume-d74f1d76-8649-425c-9df0-34439fe1026b', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:59:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5027d5-6ad8-4134-8dfe-f482e286e7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:59:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5027d5-6ad8-4134-8dfe-f482e286e7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:59:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c48e4c-af97-4cd4-9db4-a78892739bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:59:57 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Volume d74f1d76-8649-425c-9df0-34439fe1026b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d74f1d76-8649-425c-9df0-34439fe1026b', 'volume_size': 1} Jun 24 09:59:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:59:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:59:57 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T07:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-453887569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d74f1d76-8649-425c-9df0-34439fe1026b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c96dbc2789b244e1b675855ac7ab30df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T07:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T07:59:57Z,use_quota=True,user_id='df405c3b00834038a0a6f3c844b3ccdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 09:59:57 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Creating volume d74f1d76-8649-425c-9df0-34439fe1026b {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 09:59:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:59:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:59:57 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 09:59:57 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 09:59:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:59:57 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 09:59:57 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 09:59:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:57 devstack sudo[108789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b 1073741824 Jun 24 09:59:57 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:57 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_fk39wohmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7" returned: 0 in 2.330s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:57 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd371dd7-fca0-4345-9276-7b2a9b23d2c0_fk39wohmdevstack@QuobyteHD, size 112.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 {{(pid=93447) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 09:59:57 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Converted 112.00 MB image at 48.03 MB/s Jun 24 09:59:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:57 devstack sudo[108791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 1G Jun 24 09:59:57 devstack sudo[108791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:58 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b 1073741824" returned: 0 in 0.971s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:58 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b Jun 24 09:59:58 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:58 devstack sudo[108791]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 1G" returned: 0 in 0.745s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:58 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac8f964-ff2d-49a9-ad1c-176ef1b4e62c]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:59:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:58 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 Jun 24 09:59:58 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:58 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b" returned: 0 in 0.704s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:58 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 09:59:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 09:59:58 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c48e4c-af97-4cd4-9db4-a78892739bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d74f1d76-8649-425c-9df0-34439fe1026b', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:59:58 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbee967d-29c4-474f-bab1-1bdf79370dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 09:59:58 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Volume volume-d74f1d76-8649-425c-9df0-34439fe1026b (d74f1d76-8649-425c-9df0-34439fe1026b): created successfully Jun 24 09:59:58 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbee967d-29c4-474f-bab1-1bdf79370dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 09:59:58 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Flow 'volume_create_manager' (d3379c4f-f827-454c-95fd-92d164aace49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 09:59:58 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-5aed0773-0085-4bef-92c2-8a675b51dcb3 tempest-VolumesDeleteCascade-1955756731 None] Created volume successfully. Jun 24 09:59:59 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Jun 24 09:59:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7" returned: 0 in 0.853s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 09:59:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9c2f6bbf-b0b0-47da-98bc-91054f2a796a tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 09:59:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9c2f6bbf-b0b0-47da-98bc-91054f2a796a tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 09:59:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-9c2f6bbf-b0b0-47da-98bc-91054f2a796a tempest-VolumesDeleteCascade-1955756731 None] Creating offline snapshot 11b34520-be5c-4fe5-9bca-33217e3743c5 of volume d74f1d76-8649-425c-9df0-34439fe1026b {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 09:59:59 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb342d87-d181-4514-ab0d-10a7916673d2]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 09:59:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9c2f6bbf-b0b0-47da-98bc-91054f2a796a tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 09:59:59 devstack sudo[108808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 Jun 24 09:59:59 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 09:59:59 devstack sudo[108809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b Jun 24 09:59:59 devstack sudo[108809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:00 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7" returned: 1 in 0.962s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:00:00 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Downloaded image cd371dd7-fca0-4345-9276-7b2a9b23d2c0 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'metadata': {}}])) to volume ff5088d5-6636-414b-b17a-35fc7d43e7c7 successfully. {{(pid=93447) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 10:00:00 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Temporary image cd371dd7-fca0-4345-9276-7b2a9b23d2c0 for user 366a75d7c42c428aa403ce02040e2247 is deleted. {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 10:00:00 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Marking volume ff5088d5-6636-414b-b17a-35fc7d43e7c7 as bootable. {{(pid=93447) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 10:00:00 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Copying metadata from image cd371dd7-fca0-4345-9276-7b2a9b23d2c0 to ff5088d5-6636-414b-b17a-35fc7d43e7c7. {{(pid=93447) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 10:00:00 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Creating volume glance metadata for volume ff5088d5-6636-414b-b17a-35fc7d43e7c7 backed by image cd371dd7-fca0-4345-9276-7b2a9b23d2c0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93447) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 10:00:00 devstack sudo[108809]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9c2f6bbf-b0b0-47da-98bc-91054f2a796a tempest-VolumesDeleteCascade-1955756731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b" returned: 0 in 0.994s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9c2f6bbf-b0b0-47da-98bc-91054f2a796a tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:00 devstack sudo[108818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5 1G Jun 24 10:00:00 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9b8be2-f95d-4639-b8ab-bef2d7ef260a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7', 'volume_size': 1, 'image_id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48394558c0ae48f385c046476f3b062e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd371dd7-fca0-4345-9276-7b2a9b23d2c0', 'created_at': datetime.datetime(2026, 6, 24, 7, 39, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 7, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd371dd7-fca0-4345-9276-7b2a9b23d2c0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (295d634e-e657-4d51-b07e-4175ab523a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:00 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Volume volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 (ff5088d5-6636-414b-b17a-35fc7d43e7c7): created successfully Jun 24 10:00:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (295d634e-e657-4d51-b07e-4175ab523a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:00 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Flow 'volume_create_manager' (fea0f45a-d412-4121-9dc8-9febe7d5d96d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:00:00 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-afc45a30-4309-4870-abef-24733f824517 tempest-VolumesExtendTest-2143995905 None] Created volume successfully. Jun 24 10:00:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c3944ffa-67f4-4dfe-96ab-c411c0d5ffe1 tempest-VolumesExtendTest-2143995905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:01 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9c2f6bbf-b0b0-47da-98bc-91054f2a796a tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5 1G" returned: 0 in 0.892s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9c2f6bbf-b0b0-47da-98bc-91054f2a796a tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74f1d76-8649-425c-9df0-34439fe1026b -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:01 devstack sudo[108826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74f1d76-8649-425c-9df0-34439fe1026b -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5 Jun 24 10:00:01 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:01 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9c2f6bbf-b0b0-47da-98bc-91054f2a796a tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74f1d76-8649-425c-9df0-34439fe1026b -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5" returned: 0 in 0.710s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:01 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-9c2f6bbf-b0b0-47da-98bc-91054f2a796a tempest-VolumesDeleteCascade-1955756731 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5 is being set with open permissions: ugo+rw Jun 24 10:00:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9c2f6bbf-b0b0-47da-98bc-91054f2a796a tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:01 devstack sudo[108832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5 Jun 24 10:00:01 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:02 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9c2f6bbf-b0b0-47da-98bc-91054f2a796a tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5" returned: 0 in 0.687s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9c2f6bbf-b0b0-47da-98bc-91054f2a796a tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:02 devstack sudo[108842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.info Jun 24 10:00:02 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9c2f6bbf-b0b0-47da-98bc-91054f2a796a tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.info" returned: 0 in 0.690s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:03 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-9c2f6bbf-b0b0-47da-98bc-91054f2a796a tempest-VolumesDeleteCascade-1955756731 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.info is being set with open permissions: ugo+rw Jun 24 10:00:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9c2f6bbf-b0b0-47da-98bc-91054f2a796a tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:03 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:03 devstack sudo[108845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.info Jun 24 10:00:03 devstack sudo[108845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:03 devstack sudo[108845]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9c2f6bbf-b0b0-47da-98bc-91054f2a796a tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.info" returned: 0 in 0.738s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9c2f6bbf-b0b0-47da-98bc-91054f2a796a tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.798s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c3944ffa-67f4-4dfe-96ab-c411c0d5ffe1 tempest-VolumesExtendTest-2143995905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.925s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:04 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-9c2f6bbf-b0b0-47da-98bc-91054f2a796a tempest-VolumesDeleteCascade-1955756731 None] Create snapshot completed successfully Jun 24 10:00:04 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4add195-6729-42ec-9050-0e043d393fd7]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c3944ffa-67f4-4dfe-96ab-c411c0d5ffe1 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:04 devstack sudo[108849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 Jun 24 10:00:04 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-53c3dbf8-ed75-4e4e-afc4-7484e7ac68ff tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:04 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c3944ffa-67f4-4dfe-96ab-c411c0d5ffe1 tempest-VolumesExtendTest-2143995905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7" returned: 0 in 0.837s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c3944ffa-67f4-4dfe-96ab-c411c0d5ffe1 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:05 devstack sudo[108853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 Jun 24 10:00:05 devstack sudo[108853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:05 devstack sudo[108853]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c3944ffa-67f4-4dfe-96ab-c411c0d5ffe1 tempest-VolumesExtendTest-2143995905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7" returned: 1 in 0.777s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c3944ffa-67f4-4dfe-96ab-c411c0d5ffe1 tempest-VolumesExtendTest-2143995905 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:00:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c3944ffa-67f4-4dfe-96ab-c411c0d5ffe1 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 2G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c3944ffa-67f4-4dfe-96ab-c411c0d5ffe1 tempest-VolumesExtendTest-2143995905 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 2G" returned: 0 in 0.065s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c3944ffa-67f4-4dfe-96ab-c411c0d5ffe1 tempest-VolumesExtendTest-2143995905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.730s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-53c3dbf8-ed75-4e4e-afc4-7484e7ac68ff tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.131s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:05 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-53c3dbf8-ed75-4e4e-afc4-7484e7ac68ff tempest-VolumesDeleteCascade-1955756731 None] Creating offline snapshot dbab16e0-dd46-4c18-b060-38dc25a845be of volume d74f1d76-8649-425c-9df0-34439fe1026b {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 10:00:05 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecbb8b2-d2c4-491a-ba55-8ebee21dd0b4]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-53c3dbf8-ed75-4e4e-afc4-7484e7ac68ff tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:05 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-c3944ffa-67f4-4dfe-96ab-c411c0d5ffe1 tempest-VolumesExtendTest-2143995905 None] Extend volume completed successfully. Jun 24 10:00:05 devstack sudo[108861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5 Jun 24 10:00:05 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:06 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-53c3dbf8-ed75-4e4e-afc4-7484e7ac68ff tempest-VolumesDeleteCascade-1955756731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5" returned: 0 in 0.815s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:06 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-53c3dbf8-ed75-4e4e-afc4-7484e7ac68ff tempest-VolumesDeleteCascade-1955756731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d74f1d76-8649-425c-9df0-34439fe1026b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:00:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-53c3dbf8-ed75-4e4e-afc4-7484e7ac68ff tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:06 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be 1G Jun 24 10:00:06 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:06 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4704a759-2ff6-4508-acf9-afc9ba4c1ee2 tempest-VolumesExtendTest-2143995905 None] Acquiring lock "cinder-ff5088d5-6636-414b-b17a-35fc7d43e7c7-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:06 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4704a759-2ff6-4508-acf9-afc9ba4c1ee2 tempest-VolumesExtendTest-2143995905 None] Lock "cinder-ff5088d5-6636-414b-b17a-35fc7d43e7c7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:06 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4704a759-2ff6-4508-acf9-afc9ba4c1ee2 tempest-VolumesExtendTest-2143995905 None] Acquiring lock "cinder-quobyte-ff5088d5-6636-414b-b17a-35fc7d43e7c7" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:06 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4704a759-2ff6-4508-acf9-afc9ba4c1ee2 tempest-VolumesExtendTest-2143995905 None] Lock "cinder-quobyte-ff5088d5-6636-414b-b17a-35fc7d43e7c7" acquired by "delete_volume" :: waited 0.017s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:06 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a8fa8b-992c-4b12-aa6b-6299e55e489f]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4704a759-2ff6-4508-acf9-afc9ba4c1ee2 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:06 devstack sudo[108868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 Jun 24 10:00:06 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:07 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-53c3dbf8-ed75-4e4e-afc4-7484e7ac68ff tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be 1G" returned: 0 in 0.973s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-53c3dbf8-ed75-4e4e-afc4-7484e7ac68ff tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:07 devstack sudo[108876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be Jun 24 10:00:07 devstack sudo[108876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:07 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4704a759-2ff6-4508-acf9-afc9ba4c1ee2 tempest-VolumesExtendTest-2143995905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7" returned: 0 in 0.830s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4704a759-2ff6-4508-acf9-afc9ba4c1ee2 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:07 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:00:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Flow 'volume_create_manager' (25358b42-6dca-47e8-96b8-518f0066c2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:00:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a8ab4b-7762-4322-88d1-72cecd2844cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:07 devstack sudo[108878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 Jun 24 10:00:07 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a8ab4b-7762-4322-88d1-72cecd2844cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1506725814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c52018d-c4e7-462c-8246-f95e0991d964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50841b2b16644bd9d0acd22b77d7e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:00:08Z,use_quota=True,user_id='bbac0b7ecb3846c582808554448a3941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22e3743-5b44-48cf-95fc-225461432c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22e3743-5b44-48cf-95fc-225461432c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b1fb8d-b39a-4cf1-8da8-1d868cc9e659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b1fb8d-b39a-4cf1-8da8-1d868cc9e659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c52018d-c4e7-462c-8246-f95e0991d964', 'volume_name': 'volume-8c52018d-c4e7-462c-8246-f95e0991d964', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2ba82ea-c70b-4852-ad65-8a97ddfe2a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2ba82ea-c70b-4852-ad65-8a97ddfe2a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0a5341-78db-4e79-9ffe-37410ba75b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:07 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Volume 8c52018d-c4e7-462c-8246-f95e0991d964: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c52018d-c4e7-462c-8246-f95e0991d964', 'volume_size': 1} Jun 24 10:00:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:08 devstack sudo[108876]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-53c3dbf8-ed75-4e4e-afc4-7484e7ac68ff tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be" returned: 0 in 0.714s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:08 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-53c3dbf8-ed75-4e4e-afc4-7484e7ac68ff tempest-VolumesDeleteCascade-1955756731 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be is being set with open permissions: ugo+rw Jun 24 10:00:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-53c3dbf8-ed75-4e4e-afc4-7484e7ac68ff tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:08 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be Jun 24 10:00:08 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:08 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4704a759-2ff6-4508-acf9-afc9ba4c1ee2 tempest-VolumesExtendTest-2143995905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7" returned: 1 in 0.795s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4704a759-2ff6-4508-acf9-afc9ba4c1ee2 tempest-VolumesExtendTest-2143995905 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:00:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4704a759-2ff6-4508-acf9-afc9ba4c1ee2 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:08 devstack sudo[108888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7 Jun 24 10:00:08 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:09 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-53c3dbf8-ed75-4e4e-afc4-7484e7ac68ff tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be" returned: 0 in 0.664s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-53c3dbf8-ed75-4e4e-afc4-7484e7ac68ff tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.305s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.157s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1506725814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c52018d-c4e7-462c-8246-f95e0991d964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50841b2b16644bd9d0acd22b77d7e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:00:08Z,use_quota=True,user_id='bbac0b7ecb3846c582808554448a3941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Creating volume 8c52018d-c4e7-462c-8246-f95e0991d964 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:00:09 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:09 devstack sudo[108892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964 1073741824 Jun 24 10:00:09 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:09 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-53c3dbf8-ed75-4e4e-afc4-7484e7ac68ff tempest-VolumesDeleteCascade-1955756731 None] Create snapshot completed successfully Jun 24 10:00:09 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4704a759-2ff6-4508-acf9-afc9ba4c1ee2 tempest-VolumesExtendTest-2143995905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ff5088d5-6636-414b-b17a-35fc7d43e7c7" returned: 0 in 0.655s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4704a759-2ff6-4508-acf9-afc9ba4c1ee2 tempest-VolumesExtendTest-2143995905 None] Lock "cinder-quobyte-ff5088d5-6636-414b-b17a-35fc7d43e7c7" released by "delete_volume" :: held 2.368s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-4704a759-2ff6-4508-acf9-afc9ba4c1ee2 tempest-VolumesExtendTest-2143995905 None] Created reservations ['b47e3426-b33a-470a-9043-49009d31a4c8', '1faa80f2-cbd5-45e5-bd81-1f106f3d1dcf', '69b5a9bb-3f15-482e-bf34-2ef1107ed05b', '3788e7a1-a1ff-4431-b47b-39bf9001f3f1'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4704a759-2ff6-4508-acf9-afc9ba4c1ee2 tempest-VolumesExtendTest-2143995905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4704a759-2ff6-4508-acf9-afc9ba4c1ee2 tempest-VolumesExtendTest-2143995905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4704a759-2ff6-4508-acf9-afc9ba4c1ee2 tempest-VolumesExtendTest-2143995905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4704a759-2ff6-4508-acf9-afc9ba4c1ee2 tempest-VolumesExtendTest-2143995905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4704a759-2ff6-4508-acf9-afc9ba4c1ee2 tempest-VolumesExtendTest-2143995905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4704a759-2ff6-4508-acf9-afc9ba4c1ee2 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:09 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:00:09 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "cinder-d74f1d76-8649-425c-9df0-34439fe1026b-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:09 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:09 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-d74f1d76-8649-425c-9df0-34439fe1026b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4704a759-2ff6-4508-acf9-afc9ba4c1ee2 tempest-VolumesExtendTest-2143995905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.667s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-4704a759-2ff6-4508-acf9-afc9ba4c1ee2 tempest-VolumesExtendTest-2143995905 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:00:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964 1073741824" returned: 0 in 0.894s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:09 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-4704a759-2ff6-4508-acf9-afc9ba4c1ee2 tempest-VolumesExtendTest-2143995905 None] Deleted volume successfully. Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4704a759-2ff6-4508-acf9-afc9ba4c1ee2 tempest-VolumesExtendTest-2143995905 None] Lock "cinder-ff5088d5-6636-414b-b17a-35fc7d43e7c7-delete_volume" released by "delete_volume" :: held 3.277s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Performing cascade delete. {{(pid=93447) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "cinder-11b34520-be5c-4fe5-9bca-33217e3743c5-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-11b34520-be5c-4fe5-9bca-33217e3743c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:10 devstack sudo[108903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964 Jun 24 10:00:10 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "cinder-quobyte-d74f1d76-8649-425c-9df0-34439fe1026b" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-quobyte-d74f1d76-8649-425c-9df0-34439fe1026b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "cinder-quobyte-11b34520-be5c-4fe5-9bca-33217e3743c5" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-quobyte-11b34520-be5c-4fe5-9bca-33217e3743c5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Deleting offline snapshot 11b34520-be5c-4fe5-9bca-33217e3743c5 of volume d74f1d76-8649-425c-9df0-34439fe1026b {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] snapshot_file for this snap is: volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d301f98-9f84-45aa-8604-077f4849deb9]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:10 devstack sudo[108905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5 Jun 24 10:00:10 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Flow 'volume_create_manager' (83482b25-3c42-4e0f-84ab-2fee06d283e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee7d3d94-4298-4313-94b1-dbc85a1b95d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee7d3d94-4298-4313-94b1-dbc85a1b95d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-96614845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9762df7b-30c7-488d-b342-ae9a96ab1b14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c290557741e54b8f85872674f8e99055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:00:10Z,use_quota=True,user_id='366a75d7c42c428aa403ce02040e2247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ec735c-863a-4659-8be5-aa2c28ac0076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ec735c-863a-4659-8be5-aa2c28ac0076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bf889b-81c9-48b0-a9de-91af647e1bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bf889b-81c9-48b0-a9de-91af647e1bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9762df7b-30c7-488d-b342-ae9a96ab1b14', 'volume_name': 'volume-9762df7b-30c7-488d-b342-ae9a96ab1b14', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a779b6-24ff-433e-a2ec-3b74b6294f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94a779b6-24ff-433e-a2ec-3b74b6294f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f26922-7ed9-452c-8d21-799f5f4d2871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:10 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Volume 9762df7b-30c7-488d-b342-ae9a96ab1b14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9762df7b-30c7-488d-b342-ae9a96ab1b14', 'volume_size': 1} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:10 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964" returned: 0 in 0.709s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.132s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-96614845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9762df7b-30c7-488d-b342-ae9a96ab1b14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c290557741e54b8f85872674f8e99055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:00:10Z,use_quota=True,user_id='366a75d7c42c428aa403ce02040e2247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Creating volume 9762df7b-30c7-488d-b342-ae9a96ab1b14 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:00:10 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:10 devstack sudo[108908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14 1073741824 Jun 24 10:00:10 devstack sudo[108908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0a5341-78db-4e79-9ffe-37410ba75b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c52018d-c4e7-462c-8246-f95e0991d964', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f24625-d385-4205-9254-b9832bc33d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:10 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Volume volume-8c52018d-c4e7-462c-8246-f95e0991d964 (8c52018d-c4e7-462c-8246-f95e0991d964): created successfully Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f24625-d385-4205-9254-b9832bc33d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Flow 'volume_create_manager' (25358b42-6dca-47e8-96b8-518f0066c2c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:00:10 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-91d00c0c-5f62-423c-b7d7-b055c6552763 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Created volume successfully. Jun 24 10:00:11 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5" returned: 0 in 0.858s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:11 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d74f1d76-8649-425c-9df0-34439fe1026b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:00:11 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac369a94-b0fe-401d-9ec4-b56a7769f429]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:11 devstack sudo[108913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b Jun 24 10:00:11 devstack sudo[108913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:11 devstack sudo[108908]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14 1073741824" returned: 0 in 0.856s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:11 devstack sudo[108919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14 Jun 24 10:00:11 devstack sudo[108919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:11 devstack sudo[108913]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b" returned: 0 in 0.795s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:11 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e7eed1-4487-40e6-a614-0bd449f12506]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:12 devstack sudo[108925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be Jun 24 10:00:12 devstack sudo[108925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7b93f0c2-5d0f-4059-b96a-d6d14ce05d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:12 devstack sudo[108919]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14" returned: 0 in 0.680s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:00:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7b93f0c2-5d0f-4059-b96a-d6d14ce05d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.087s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07f26922-7ed9-452c-8d21-799f5f4d2871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9762df7b-30c7-488d-b342-ae9a96ab1b14', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a32c803-8193-4a71-b7d8-835ea53d4227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-7b93f0c2-5d0f-4059-b96a-d6d14ce05d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Creating offline snapshot 6d839686-1e5a-4385-9300-f0d70e771595 of volume 8c52018d-c4e7-462c-8246-f95e0991d964 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 10:00:12 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Volume volume-9762df7b-30c7-488d-b342-ae9a96ab1b14 (9762df7b-30c7-488d-b342-ae9a96ab1b14): created successfully Jun 24 10:00:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a32c803-8193-4a71-b7d8-835ea53d4227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Flow 'volume_create_manager' (83482b25-3c42-4e0f-84ab-2fee06d283e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:00:12 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7586744-f327-455c-aa4e-31253b11717c]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7b93f0c2-5d0f-4059-b96a-d6d14ce05d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:12 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-f66d17ee-1158-407b-b1dc-abec8b0db5e2 tempest-VolumesExtendTest-2143995905 None] Created volume successfully. Jun 24 10:00:12 devstack sudo[108928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964 Jun 24 10:00:12 devstack sudo[108928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:12 devstack sudo[108925]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be" returned: 0 in 0.858s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d74f1d76-8649-425c-9df0-34439fe1026b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:00:12 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[368cd7bc-80bb-455e-b3bf-45b5981bf65f]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5c50f936-2fc5-486d-a638-93cc7cf79047 tempest-VolumesExtendTest-2143995905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:12 devstack sudo[108934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5 Jun 24 10:00:12 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:13 devstack sudo[108928]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7b93f0c2-5d0f-4059-b96a-d6d14ce05d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964" returned: 0 in 0.804s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7b93f0c2-5d0f-4059-b96a-d6d14ce05d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.6d839686-1e5a-4385-9300-f0d70e771595 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:13 devstack sudo[108939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.6d839686-1e5a-4385-9300-f0d70e771595 1G Jun 24 10:00:13 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:13 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5" returned: 0 in 0.767s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d74f1d76-8649-425c-9df0-34439fe1026b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:00:13 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6115cfab-9bdc-4e5a-8b62-63ecdd5d8580]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:13 devstack sudo[108944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b Jun 24 10:00:13 devstack sudo[108944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:14 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7b93f0c2-5d0f-4059-b96a-d6d14ce05d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.6d839686-1e5a-4385-9300-f0d70e771595 1G" returned: 0 in 0.810s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7b93f0c2-5d0f-4059-b96a-d6d14ce05d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c52018d-c4e7-462c-8246-f95e0991d964 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.6d839686-1e5a-4385-9300-f0d70e771595 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:14 devstack sudo[108949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c52018d-c4e7-462c-8246-f95e0991d964 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.6d839686-1e5a-4385-9300-f0d70e771595 Jun 24 10:00:14 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:14 devstack sudo[108944]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b" returned: 0 in 0.784s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:14 devstack sudo[108954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5 Jun 24 10:00:14 devstack sudo[108954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:14 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7b93f0c2-5d0f-4059-b96a-d6d14ce05d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c52018d-c4e7-462c-8246-f95e0991d964 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.6d839686-1e5a-4385-9300-f0d70e771595" returned: 0 in 0.693s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:14 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-7b93f0c2-5d0f-4059-b96a-d6d14ce05d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.6d839686-1e5a-4385-9300-f0d70e771595 is being set with open permissions: ugo+rw Jun 24 10:00:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7b93f0c2-5d0f-4059-b96a-d6d14ce05d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.6d839686-1e5a-4385-9300-f0d70e771595 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:14 devstack sudo[108959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.6d839686-1e5a-4385-9300-f0d70e771595 Jun 24 10:00:14 devstack sudo[108959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:15 devstack sudo[108954]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5" returned: 0 in 0.725s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:15 devstack sudo[108964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5 Jun 24 10:00:15 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:15 devstack sudo[108959]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7b93f0c2-5d0f-4059-b96a-d6d14ce05d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.6d839686-1e5a-4385-9300-f0d70e771595" returned: 0 in 0.709s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7b93f0c2-5d0f-4059-b96a-d6d14ce05d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:15 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.info Jun 24 10:00:15 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:15 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.11b34520-be5c-4fe5-9bca-33217e3743c5" returned: 0 in 0.648s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74f1d76-8649-425c-9df0-34439fe1026b /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be -F qcow2 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:15 devstack sudo[108970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74f1d76-8649-425c-9df0-34439fe1026b /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be -F qcow2 Jun 24 10:00:15 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:16 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7b93f0c2-5d0f-4059-b96a-d6d14ce05d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.info" returned: 0 in 0.638s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:16 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-7b93f0c2-5d0f-4059-b96a-d6d14ce05d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.info is being set with open permissions: ugo+rw Jun 24 10:00:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7b93f0c2-5d0f-4059-b96a-d6d14ce05d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:16 devstack sudo[108973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.info Jun 24 10:00:16 devstack sudo[108973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:16 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d74f1d76-8649-425c-9df0-34439fe1026b /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be -F qcow2" returned: 0 in 0.683s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:16 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-quobyte-11b34520-be5c-4fe5-9bca-33217e3743c5" released by "_delete_snapshot" :: held 6.310s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:16 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-quobyte-d74f1d76-8649-425c-9df0-34439fe1026b" released by "delete_snapshot" :: held 6.335s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:16 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Created reservations ['5ff77dbb-220a-40ee-b89a-c6b5946a4604', 'f79ab052-ef17-4b04-80ba-1190afb7064c', '9173df1d-05fe-476a-9a73-35c138027ed6', 'e6afe13d-a604-48c5-a879-1e4b01a3fa8a'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:00:16 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Delete snapshot completed successfully. Jun 24 10:00:16 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-11b34520-be5c-4fe5-9bca-33217e3743c5-delete_snapshot" released by "delete_snapshot" :: held 6.504s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:16 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "cinder-dbab16e0-dd46-4c18-b060-38dc25a845be-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:16 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-dbab16e0-dd46-4c18-b060-38dc25a845be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:16 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "cinder-quobyte-d74f1d76-8649-425c-9df0-34439fe1026b" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:16 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-quobyte-d74f1d76-8649-425c-9df0-34439fe1026b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:16 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "cinder-quobyte-dbab16e0-dd46-4c18-b060-38dc25a845be" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:16 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-quobyte-dbab16e0-dd46-4c18-b060-38dc25a845be" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:16 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Deleting offline snapshot dbab16e0-dd46-4c18-b060-38dc25a845be of volume d74f1d76-8649-425c-9df0-34439fe1026b {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 10:00:16 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] snapshot_file for this snap is: volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 10:00:16 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cbc5fd-4742-479d-b6c9-bbb8b4d9c054]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:16 devstack sudo[108973]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7b93f0c2-5d0f-4059-b96a-d6d14ce05d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.info" returned: 0 in 0.670s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7b93f0c2-5d0f-4059-b96a-d6d14ce05d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.439s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5c50f936-2fc5-486d-a638-93cc7cf79047 tempest-VolumesExtendTest-2143995905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.960s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:16 devstack sudo[108979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be Jun 24 10:00:16 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:16 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-5c50f936-2fc5-486d-a638-93cc7cf79047 tempest-VolumesExtendTest-2143995905 None] Creating offline snapshot 5e351530-2185-45a9-a223-3bce4e4d426b of volume 9762df7b-30c7-488d-b342-ae9a96ab1b14 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 10:00:16 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b81bc76-ec7a-4980-abab-2d2fe7dcd3a2]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5c50f936-2fc5-486d-a638-93cc7cf79047 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:16 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-7b93f0c2-5d0f-4059-b96a-d6d14ce05d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Create snapshot completed successfully Jun 24 10:00:16 devstack sudo[108981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14 Jun 24 10:00:16 devstack sudo[108981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:17 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be" returned: 0 in 0.787s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:17 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d74f1d76-8649-425c-9df0-34439fe1026b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:00:17 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee274ad-c232-4c92-8582-817659177b75]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:17 devstack sudo[108989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b Jun 24 10:00:17 devstack sudo[108981]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:17 devstack sudo[108989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5c50f936-2fc5-486d-a638-93cc7cf79047 tempest-VolumesExtendTest-2143995905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14" returned: 0 in 0.808s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5c50f936-2fc5-486d-a638-93cc7cf79047 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.5e351530-2185-45a9-a223-3bce4e4d426b 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:17 devstack sudo[108991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.5e351530-2185-45a9-a223-3bce4e4d426b 1G Jun 24 10:00:17 devstack sudo[108991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Flow 'volume_create_manager' (a506705b-3012-47a6-8777-87dbbb73bb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d2a4bc8-1016-4e46-8b1d-3e0674133721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=82,cinder:UPDATE=64,cinder:INSERT=25,cinder:DELETE=3 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d2a4bc8-1016-4e46-8b1d-3e0674133721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2145832109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3139f54-041a-4436-a1ac-30f4f583018d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50841b2b16644bd9d0acd22b77d7e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:00:18Z,use_quota=True,user_id='bbac0b7ecb3846c582808554448a3941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf8b4e9-313c-4692-a45c-373133697f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf8b4e9-313c-4692-a45c-373133697f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1cb870-160b-46ab-bc80-1a7390f5e2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb1cb870-160b-46ab-bc80-1a7390f5e2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3139f54-041a-4436-a1ac-30f4f583018d', 'volume_name': 'volume-d3139f54-041a-4436-a1ac-30f4f583018d', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d50afe3-fe23-4111-a959-71a50b7c9e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d50afe3-fe23-4111-a959-71a50b7c9e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4185f5e2-8d3d-4913-9512-0c83f0426013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:18 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Volume d3139f54-041a-4436-a1ac-30f4f583018d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3139f54-041a-4436-a1ac-30f4f583018d', 'volume_size': 1} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:18 devstack sudo[108989]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b" returned: 0 in 0.923s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:18 devstack sudo[109000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be Jun 24 10:00:18 devstack sudo[109000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Flow 'volume_create_manager' (19261590-a5ba-4d5b-a49e-d7280786bc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7738c6-5d2e-4a38-9bf8-cf22586811bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:UPDATE=75,cinder:SELECT=57,cinder:INSERT=20,cinder:DELETE=10 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7738c6-5d2e-4a38-9bf8-cf22586811bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-953667504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=413be76e-ece6-4f63-a620-fb2bc3ad05e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50841b2b16644bd9d0acd22b77d7e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:00:18Z,use_quota=True,user_id='bbac0b7ecb3846c582808554448a3941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18eeb6d6-bc89-4d45-892c-64b9dc84c1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18eeb6d6-bc89-4d45-892c-64b9dc84c1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16a3c3c-877c-4435-b01e-ee8e40a66539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16a3c3c-877c-4435-b01e-ee8e40a66539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '413be76e-ece6-4f63-a620-fb2bc3ad05e5', 'volume_name': 'volume-413be76e-ece6-4f63-a620-fb2bc3ad05e5', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae226c31-c153-45e7-bfe1-99dc1b0930f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:18 devstack sudo[108991]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae226c31-c153-45e7-bfe1-99dc1b0930f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16f3465-f315-4f34-af20-ccfd17a1191f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:18 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Volume 413be76e-ece6-4f63-a620-fb2bc3ad05e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-413be76e-ece6-4f63-a620-fb2bc3ad05e5', 'volume_size': 1} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5c50f936-2fc5-486d-a638-93cc7cf79047 tempest-VolumesExtendTest-2143995905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.5e351530-2185-45a9-a223-3bce4e4d426b 1G" returned: 0 in 1.023s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5c50f936-2fc5-486d-a638-93cc7cf79047 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9762df7b-30c7-488d-b342-ae9a96ab1b14 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.5e351530-2185-45a9-a223-3bce4e4d426b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:18 devstack sudo[109002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9762df7b-30c7-488d-b342-ae9a96ab1b14 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.5e351530-2185-45a9-a223-3bce4e4d426b Jun 24 10:00:18 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Flow 'volume_create_manager' (adb782aa-7cfa-4b8b-ac84-d4f0d5f10399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1598131a-7a8b-42c8-8e88-2a97289a1cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1598131a-7a8b-42c8-8e88-2a97289a1cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-903688789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a4e15f3-a089-4138-accf-a96f462db09f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50841b2b16644bd9d0acd22b77d7e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:00:19Z,use_quota=True,user_id='bbac0b7ecb3846c582808554448a3941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96f4d8a-c120-484a-b5a1-fcc7b01cff89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e96f4d8a-c120-484a-b5a1-fcc7b01cff89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052edbfc-5592-49cf-b70f-9bd87f1c229c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052edbfc-5592-49cf-b70f-9bd87f1c229c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a4e15f3-a089-4138-accf-a96f462db09f', 'volume_name': 'volume-0a4e15f3-a089-4138-accf-a96f462db09f', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d999389d-2e82-4f2d-8997-1d818c61401e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d999389d-2e82-4f2d-8997-1d818c61401e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595f28b2-a10f-4c97-a54d-4cb7b2588855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:19 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Volume 0a4e15f3-a089-4138-accf-a96f462db09f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a4e15f3-a089-4138-accf-a96f462db09f', 'volume_size': 1} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Flow 'volume_create_manager' (a05d3956-4374-446e-b264-563593390809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e837aa1c-e97a-42f2-ae4a-f8d1bf5085d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e837aa1c-e97a-42f2-ae4a-f8d1bf5085d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-621668446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e05410ce-097c-43ff-957d-543d3ecba55a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50841b2b16644bd9d0acd22b77d7e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:00:19Z,use_quota=True,user_id='bbac0b7ecb3846c582808554448a3941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9b6a4f-57bd-4747-b3a6-93625b656f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9b6a4f-57bd-4747-b3a6-93625b656f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:19 devstack sudo[109000]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac78914-7cc2-45bb-8f92-24be06849a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac78914-7cc2-45bb-8f92-24be06849a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e05410ce-097c-43ff-957d-543d3ecba55a', 'volume_name': 'volume-e05410ce-097c-43ff-957d-543d3ecba55a', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a56d965-e675-41bd-a98f-7ee4c84ecfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a56d965-e675-41bd-a98f-7ee4c84ecfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d8cc05-8978-48f8-9de9-a16ae866e225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:19 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Volume e05410ce-097c-43ff-957d-543d3ecba55a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e05410ce-097c-43ff-957d-543d3ecba55a', 'volume_size': 1} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be" returned: 0 in 0.925s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:19 devstack sudo[109009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be Jun 24 10:00:19 devstack sudo[109009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:19 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5c50f936-2fc5-486d-a638-93cc7cf79047 tempest-VolumesExtendTest-2143995905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9762df7b-30c7-488d-b342-ae9a96ab1b14 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.5e351530-2185-45a9-a223-3bce4e4d426b" returned: 0 in 0.900s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:19 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-5c50f936-2fc5-486d-a638-93cc7cf79047 tempest-VolumesExtendTest-2143995905 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.5e351530-2185-45a9-a223-3bce4e4d426b is being set with open permissions: ugo+rw Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5c50f936-2fc5-486d-a638-93cc7cf79047 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.5e351530-2185-45a9-a223-3bce4e4d426b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:19 devstack sudo[109013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.5e351530-2185-45a9-a223-3bce4e4d426b Jun 24 10:00:19 devstack sudo[109013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Flow 'volume_create_manager' (1a717211-30ee-4d22-8d83-93e2ee99536e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff943284-3344-4381-9ea8-ad0890b4d941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff943284-3344-4381-9ea8-ad0890b4d941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-149629212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6367f0b4-07c5-4ce5-ae87-a44fb9868604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50841b2b16644bd9d0acd22b77d7e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:00:20Z,use_quota=True,user_id='bbac0b7ecb3846c582808554448a3941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d5f9a6-0ea2-4c44-9b0d-8ef64d300d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d5f9a6-0ea2-4c44-9b0d-8ef64d300d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b4b79e-49bf-4e6d-bd0f-b0f510cdd604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b4b79e-49bf-4e6d-bd0f-b0f510cdd604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6367f0b4-07c5-4ce5-ae87-a44fb9868604', 'volume_name': 'volume-6367f0b4-07c5-4ce5-ae87-a44fb9868604', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b62d01-60cf-4b11-98ca-05adb7649cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b62d01-60cf-4b11-98ca-05adb7649cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a725ef2-3916-4e78-8e91-e3995a680378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:19 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Volume 6367f0b4-07c5-4ce5-ae87-a44fb9868604: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6367f0b4-07c5-4ce5-ae87-a44fb9868604', 'volume_size': 1} Jun 24 10:00:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:20 devstack sudo[109009]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b.dbab16e0-dd46-4c18-b060-38dc25a845be" returned: 0 in 0.710s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:20 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-quobyte-dbab16e0-dd46-4c18-b060-38dc25a845be" released by "_delete_snapshot" :: held 3.451s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:20 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-quobyte-d74f1d76-8649-425c-9df0-34439fe1026b" released by "delete_snapshot" :: held 3.472s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:20 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Created reservations ['a19a72da-2d6b-4a44-8ea5-92693f94aa15', '4d77a50f-db93-4d5a-b799-c69b32dd3e5e', 'e08b422d-d077-45cf-82a1-19ecd3043f98', 'e7a1ee23-9e45-4e38-9919-82ae0cfb3013'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:00:20 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Delete snapshot completed successfully. Jun 24 10:00:20 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-dbab16e0-dd46-4c18-b060-38dc25a845be-delete_snapshot" released by "delete_snapshot" :: held 3.632s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:20 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Snapshots deleted, issuing volume delete {{(pid=93447) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 24 10:00:20 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "cinder-quobyte-d74f1d76-8649-425c-9df0-34439fe1026b" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:20 devstack sudo[109013]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5c50f936-2fc5-486d-a638-93cc7cf79047 tempest-VolumesExtendTest-2143995905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.5e351530-2185-45a9-a223-3bce4e4d426b" returned: 0 in 0.686s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:20 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-quobyte-d74f1d76-8649-425c-9df0-34439fe1026b" acquired by "delete_volume" :: waited 0.019s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:20 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c5e137-821c-48b6-88f2-72b4413ee890]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5c50f936-2fc5-486d-a638-93cc7cf79047 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:20 devstack sudo[109018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.info Jun 24 10:00:20 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:20 devstack sudo[109017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b Jun 24 10:00:20 devstack sudo[109017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:20 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5c50f936-2fc5-486d-a638-93cc7cf79047 tempest-VolumesExtendTest-2143995905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.info" returned: 0 in 0.676s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:20 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-5c50f936-2fc5-486d-a638-93cc7cf79047 tempest-VolumesExtendTest-2143995905 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.info is being set with open permissions: ugo+rw Jun 24 10:00:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5c50f936-2fc5-486d-a638-93cc7cf79047 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:21 devstack sudo[109025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.info Jun 24 10:00:21 devstack sudo[109025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:21 devstack sudo[109017]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b" returned: 0 in 0.759s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:21 devstack sudo[109027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b Jun 24 10:00:21 devstack sudo[109027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:21 devstack sudo[109025]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5c50f936-2fc5-486d-a638-93cc7cf79047 tempest-VolumesExtendTest-2143995905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.info" returned: 0 in 0.650s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5c50f936-2fc5-486d-a638-93cc7cf79047 tempest-VolumesExtendTest-2143995905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.882s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.405s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2145832109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3139f54-041a-4436-a1ac-30f4f583018d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50841b2b16644bd9d0acd22b77d7e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:00:18Z,use_quota=True,user_id='bbac0b7ecb3846c582808554448a3941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:00:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Creating volume d3139f54-041a-4436-a1ac-30f4f583018d {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:00:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:00:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:00:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:00:21 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:00:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d3139f54-041a-4436-a1ac-30f4f583018d 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:21 devstack sudo[109031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d3139f54-041a-4436-a1ac-30f4f583018d 1073741824 Jun 24 10:00:21 devstack sudo[109031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:21 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-5c50f936-2fc5-486d-a638-93cc7cf79047 tempest-VolumesExtendTest-2143995905 None] Create snapshot completed successfully Jun 24 10:00:21 devstack sudo[109027]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d74f1d76-8649-425c-9df0-34439fe1026b" returned: 0 in 0.696s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:21 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-quobyte-d74f1d76-8649-425c-9df0-34439fe1026b" released by "delete_volume" :: held 1.514s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:21 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Created reservations ['22842c37-3bc1-4bba-a3bb-d98c5134937c', '0a7ec4e3-c753-4f4c-bdab-6e0117e04740', '954d5e59-6781-4614-888e-8fe3fc39acff', '35e7269b-f641-4e86-a694-0d50a2643e97'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:00:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:00:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:00:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:21 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:00:21 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e9fd22a6-9592-4d60-9e3c-38a27f551adb tempest-VolumesExtendTest-2143995905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:22 devstack sudo[109031]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d3139f54-041a-4436-a1ac-30f4f583018d 1073741824" returned: 0 in 0.854s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d3139f54-041a-4436-a1ac-30f4f583018d {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:22 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.678s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:22 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:00:22 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Deleted volume successfully. Jun 24 10:00:22 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d3139f54-041a-4436-a1ac-30f4f583018d Jun 24 10:00:22 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:22 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7483fb24-ea80-4da8-98f8-23f9ceea0f94 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-d74f1d76-8649-425c-9df0-34439fe1026b-delete_volume" released by "delete_volume" :: held 12.655s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:23 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d3139f54-041a-4436-a1ac-30f4f583018d" returned: 0 in 0.668s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.580s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-953667504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=413be76e-ece6-4f63-a620-fb2bc3ad05e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50841b2b16644bd9d0acd22b77d7e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:00:18Z,use_quota=True,user_id='bbac0b7ecb3846c582808554448a3941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Creating volume 413be76e-ece6-4f63-a620-fb2bc3ad05e5 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:00:23 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-413be76e-ece6-4f63-a620-fb2bc3ad05e5 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4185f5e2-8d3d-4913-9512-0c83f0426013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3139f54-041a-4436-a1ac-30f4f583018d', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99d5a1d-e038-4f73-8b3d-22749108477f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:23 devstack sudo[109044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-413be76e-ece6-4f63-a620-fb2bc3ad05e5 1073741824 Jun 24 10:00:23 devstack sudo[109044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:23 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Volume volume-d3139f54-041a-4436-a1ac-30f4f583018d (d3139f54-041a-4436-a1ac-30f4f583018d): created successfully Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99d5a1d-e038-4f73-8b3d-22749108477f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Flow 'volume_create_manager' (a506705b-3012-47a6-8777-87dbbb73bb9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:00:23 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-6c85c145-57fd-46f1-aa1a-cc839f0d761e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Created volume successfully. Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Flow 'volume_create_manager' (576361a0-e5c3-4462-b685-0bc9fcffdf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106341eb-03be-4e04-9bb0-bc4af61a27bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106341eb-03be-4e04-9bb0-bc4af61a27bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-842224704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab63fd52-3899-4f16-9296-2263ba993d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c96dbc2789b244e1b675855ac7ab30df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:00:23Z,use_quota=True,user_id='df405c3b00834038a0a6f3c844b3ccdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7177e605-d280-4654-a8c9-00d50912ce0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7177e605-d280-4654-a8c9-00d50912ce0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29cf97e-ee27-49fe-98e3-7c6bd91ea054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29cf97e-ee27-49fe-98e3-7c6bd91ea054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab63fd52-3899-4f16-9296-2263ba993d26', 'volume_name': 'volume-ab63fd52-3899-4f16-9296-2263ba993d26', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db925d03-162f-4414-a06f-6491b2f31d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db925d03-162f-4414-a06f-6491b2f31d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98e62f84-1bd8-49b7-a1fd-783be72851e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:23 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Volume ab63fd52-3899-4f16-9296-2263ba993d26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab63fd52-3899-4f16-9296-2263ba993d26', 'volume_size': 1} Jun 24 10:00:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:24 devstack sudo[109044]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-413be76e-ece6-4f63-a620-fb2bc3ad05e5 1073741824" returned: 0 in 0.865s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-413be76e-ece6-4f63-a620-fb2bc3ad05e5 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:24 devstack sudo[109050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-413be76e-ece6-4f63-a620-fb2bc3ad05e5 Jun 24 10:00:24 devstack sudo[109050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:24 devstack sudo[109050]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-413be76e-ece6-4f63-a620-fb2bc3ad05e5" returned: 0 in 0.672s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:00:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.818s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-903688789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a4e15f3-a089-4138-accf-a96f462db09f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50841b2b16644bd9d0acd22b77d7e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:00:19Z,use_quota=True,user_id='bbac0b7ecb3846c582808554448a3941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:00:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Creating volume 0a4e15f3-a089-4138-accf-a96f462db09f {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:00:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:00:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:00:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:00:24 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:00:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0a4e15f3-a089-4138-accf-a96f462db09f 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:24 devstack sudo[109089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0a4e15f3-a089-4138-accf-a96f462db09f 1073741824 Jun 24 10:00:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16f3465-f315-4f34-af20-ccfd17a1191f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-413be76e-ece6-4f63-a620-fb2bc3ad05e5', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:24 devstack sudo[109089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe11b9e7-967e-4897-b3ab-cb27b285c8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:24 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Volume volume-413be76e-ece6-4f63-a620-fb2bc3ad05e5 (413be76e-ece6-4f63-a620-fb2bc3ad05e5): created successfully Jun 24 10:00:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe11b9e7-967e-4897-b3ab-cb27b285c8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Flow 'volume_create_manager' (19261590-a5ba-4d5b-a49e-d7280786bc4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:00:24 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-531b087b-8706-4cb5-8260-0f44cdba6fc9 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Created volume successfully. Jun 24 10:00:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 10:00:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:00:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:00:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:25 devstack sudo[109091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:00:25 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:25 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.644s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:00:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 10:00:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 28 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 10:00:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 10:00:25 devstack sudo[109089]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0a4e15f3-a089-4138-accf-a96f462db09f 1073741824" returned: 0 in 0.869s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0a4e15f3-a089-4138-accf-a96f462db09f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:25 devstack sudo[109097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0a4e15f3-a089-4138-accf-a96f462db09f Jun 24 10:00:25 devstack sudo[109097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:26 devstack sudo[109097]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0a4e15f3-a089-4138-accf-a96f462db09f" returned: 0 in 0.627s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:00:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.015s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-621668446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e05410ce-097c-43ff-957d-543d3ecba55a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50841b2b16644bd9d0acd22b77d7e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:00:19Z,use_quota=True,user_id='bbac0b7ecb3846c582808554448a3941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:00:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Creating volume e05410ce-097c-43ff-957d-543d3ecba55a {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:00:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:00:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:00:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:00:26 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:00:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e05410ce-097c-43ff-957d-543d3ecba55a 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595f28b2-a10f-4c97-a54d-4cb7b2588855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a4e15f3-a089-4138-accf-a96f462db09f', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:26 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e05410ce-097c-43ff-957d-543d3ecba55a 1073741824 Jun 24 10:00:26 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e029c62c-46c4-497a-bf79-06cd93a8eeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:26 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Volume volume-0a4e15f3-a089-4138-accf-a96f462db09f (0a4e15f3-a089-4138-accf-a96f462db09f): created successfully Jun 24 10:00:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e029c62c-46c4-497a-bf79-06cd93a8eeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Flow 'volume_create_manager' (adb782aa-7cfa-4b8b-ac84-d4f0d5f10399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:00:26 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-7cb725bf-7320-421c-8960-052b6f9b0972 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Created volume successfully. Jun 24 10:00:27 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e05410ce-097c-43ff-957d-543d3ecba55a 1073741824" returned: 0 in 0.829s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e05410ce-097c-43ff-957d-543d3ecba55a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:27 devstack sudo[109106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e05410ce-097c-43ff-957d-543d3ecba55a Jun 24 10:00:27 devstack sudo[109106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:27 devstack sudo[109106]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e05410ce-097c-43ff-957d-543d3ecba55a" returned: 0 in 0.632s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:00:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.153s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-149629212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6367f0b4-07c5-4ce5-ae87-a44fb9868604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50841b2b16644bd9d0acd22b77d7e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:00:20Z,use_quota=True,user_id='bbac0b7ecb3846c582808554448a3941',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:00:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Creating volume 6367f0b4-07c5-4ce5-ae87-a44fb9868604 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:00:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:00:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:00:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:00:27 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:00:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6367f0b4-07c5-4ce5-ae87-a44fb9868604 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d8cc05-8978-48f8-9de9-a16ae866e225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e05410ce-097c-43ff-957d-543d3ecba55a', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92db9774-13f3-4cb7-8ada-16b2516bc173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:27 devstack sudo[109109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6367f0b4-07c5-4ce5-ae87-a44fb9868604 1073741824 Jun 24 10:00:27 devstack sudo[109109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:27 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Volume volume-e05410ce-097c-43ff-957d-543d3ecba55a (e05410ce-097c-43ff-957d-543d3ecba55a): created successfully Jun 24 10:00:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92db9774-13f3-4cb7-8ada-16b2516bc173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Flow 'volume_create_manager' (a05d3956-4374-446e-b264-563593390809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:00:27 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-0c5da06a-31ab-473f-812e-f2cc70028d85 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Created volume successfully. Jun 24 10:00:28 devstack sudo[109109]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6367f0b4-07c5-4ce5-ae87-a44fb9868604 1073741824" returned: 0 in 0.800s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6367f0b4-07c5-4ce5-ae87-a44fb9868604 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:28 devstack sudo[109114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6367f0b4-07c5-4ce5-ae87-a44fb9868604 Jun 24 10:00:28 devstack sudo[109114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:29 devstack sudo[109114]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6367f0b4-07c5-4ce5-ae87-a44fb9868604" returned: 0 in 0.632s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:29 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:00:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e9fd22a6-9592-4d60-9e3c-38a27f551adb tempest-VolumesExtendTest-2143995905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 7.033s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a725ef2-3916-4e78-8e91-e3995a680378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6367f0b4-07c5-4ce5-ae87-a44fb9868604', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208e6074-f68a-493e-9b57-d897d7d8cf80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:29 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5725f6-cdcc-4326-8b75-ff5f5cac0215]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e9fd22a6-9592-4d60-9e3c-38a27f551adb tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:29 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Volume volume-6367f0b4-07c5-4ce5-ae87-a44fb9868604 (6367f0b4-07c5-4ce5-ae87-a44fb9868604): created successfully Jun 24 10:00:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208e6074-f68a-493e-9b57-d897d7d8cf80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Flow 'volume_create_manager' (1a717211-30ee-4d22-8d83-93e2ee99536e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:00:29 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-ade4723c-8b1a-4431-8495-43f2a457c7a0 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Created volume successfully. Jun 24 10:00:29 devstack sudo[109117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14 Jun 24 10:00:29 devstack sudo[109117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:30 devstack sudo[109117]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e9fd22a6-9592-4d60-9e3c-38a27f551adb tempest-VolumesExtendTest-2143995905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14" returned: 0 in 0.774s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e9fd22a6-9592-4d60-9e3c-38a27f551adb tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.5e351530-2185-45a9-a223-3bce4e4d426b 2G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e9fd22a6-9592-4d60-9e3c-38a27f551adb tempest-VolumesExtendTest-2143995905 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.5e351530-2185-45a9-a223-3bce4e4d426b 2G" returned: 0 in 0.119s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e9fd22a6-9592-4d60-9e3c-38a27f551adb tempest-VolumesExtendTest-2143995905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.931s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.719s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:30 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-842224704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab63fd52-3899-4f16-9296-2263ba993d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c96dbc2789b244e1b675855ac7ab30df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:00:23Z,use_quota=True,user_id='df405c3b00834038a0a6f3c844b3ccdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:00:30 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Creating volume ab63fd52-3899-4f16-9296-2263ba993d26 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:00:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:30 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:00:30 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:00:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:30 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:00:30 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:00:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:30 devstack sudo[109126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26 1073741824 Jun 24 10:00:30 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:30 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-e9fd22a6-9592-4d60-9e3c-38a27f551adb tempest-VolumesExtendTest-2143995905 None] Extend volume completed successfully. Jun 24 10:00:30 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8818cb2b-6cbb-4360-839f-40b4bb0e8f1f tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "cinder-6367f0b4-07c5-4ce5-ae87-a44fb9868604-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:30 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8818cb2b-6cbb-4360-839f-40b4bb0e8f1f tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-6367f0b4-07c5-4ce5-ae87-a44fb9868604-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:30 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8818cb2b-6cbb-4360-839f-40b4bb0e8f1f tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "cinder-quobyte-6367f0b4-07c5-4ce5-ae87-a44fb9868604" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:30 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8818cb2b-6cbb-4360-839f-40b4bb0e8f1f tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-quobyte-6367f0b4-07c5-4ce5-ae87-a44fb9868604" acquired by "delete_volume" :: waited 0.015s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:30 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6e8451-d0b7-4e26-85cf-6527e6db6377]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8818cb2b-6cbb-4360-839f-40b4bb0e8f1f tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6367f0b4-07c5-4ce5-ae87-a44fb9868604 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:30 devstack sudo[109128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6367f0b4-07c5-4ce5-ae87-a44fb9868604 Jun 24 10:00:30 devstack sudo[109128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:30 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-08d2ea17-bcc7-480f-bce5-c80527c3e504 tempest-VolumesExtendTest-2143995905 None] Acquiring lock "cinder-5e351530-2185-45a9-a223-3bce4e4d426b-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-08d2ea17-bcc7-480f-bce5-c80527c3e504 tempest-VolumesExtendTest-2143995905 None] Lock "cinder-5e351530-2185-45a9-a223-3bce4e4d426b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-08d2ea17-bcc7-480f-bce5-c80527c3e504 tempest-VolumesExtendTest-2143995905 None] Acquiring lock "cinder-quobyte-9762df7b-30c7-488d-b342-ae9a96ab1b14" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-08d2ea17-bcc7-480f-bce5-c80527c3e504 tempest-VolumesExtendTest-2143995905 None] Lock "cinder-quobyte-9762df7b-30c7-488d-b342-ae9a96ab1b14" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-08d2ea17-bcc7-480f-bce5-c80527c3e504 tempest-VolumesExtendTest-2143995905 None] Acquiring lock "cinder-quobyte-5e351530-2185-45a9-a223-3bce4e4d426b" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-08d2ea17-bcc7-480f-bce5-c80527c3e504 tempest-VolumesExtendTest-2143995905 None] Lock "cinder-quobyte-5e351530-2185-45a9-a223-3bce4e4d426b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:31 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-08d2ea17-bcc7-480f-bce5-c80527c3e504 tempest-VolumesExtendTest-2143995905 None] Deleting offline snapshot 5e351530-2185-45a9-a223-3bce4e4d426b of volume 9762df7b-30c7-488d-b342-ae9a96ab1b14 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 10:00:31 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-08d2ea17-bcc7-480f-bce5-c80527c3e504 tempest-VolumesExtendTest-2143995905 None] snapshot_file for this snap is: volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.5e351530-2185-45a9-a223-3bce4e4d426b {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 10:00:31 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b148a5b-91e8-4b05-b5ea-036615333cbf]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-08d2ea17-bcc7-480f-bce5-c80527c3e504 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.5e351530-2185-45a9-a223-3bce4e4d426b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:31 devstack sudo[109134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.5e351530-2185-45a9-a223-3bce4e4d426b Jun 24 10:00:31 devstack sudo[109134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:31 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26 1073741824" returned: 0 in 0.971s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:31 devstack sudo[109128]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8818cb2b-6cbb-4360-839f-40b4bb0e8f1f tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6367f0b4-07c5-4ce5-ae87-a44fb9868604" returned: 0 in 0.797s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8818cb2b-6cbb-4360-839f-40b4bb0e8f1f tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6367f0b4-07c5-4ce5-ae87-a44fb9868604 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:31 devstack sudo[109139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26 Jun 24 10:00:31 devstack sudo[109139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:31 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6367f0b4-07c5-4ce5-ae87-a44fb9868604 Jun 24 10:00:31 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:31 devstack sudo[109134]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-08d2ea17-bcc7-480f-bce5-c80527c3e504 tempest-VolumesExtendTest-2143995905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.5e351530-2185-45a9-a223-3bce4e4d426b" returned: 0 in 0.798s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:31 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-08d2ea17-bcc7-480f-bce5-c80527c3e504 tempest-VolumesExtendTest-2143995905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9762df7b-30c7-488d-b342-ae9a96ab1b14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:00:31 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[965307e5-6e79-43f0-af52-62b0dd434522]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-08d2ea17-bcc7-480f-bce5-c80527c3e504 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:31 devstack sudo[109139]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26" returned: 0 in 0.677s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:31 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:00:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:31 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8818cb2b-6cbb-4360-839f-40b4bb0e8f1f tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-6367f0b4-07c5-4ce5-ae87-a44fb9868604" returned: 0 in 0.668s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:32 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8818cb2b-6cbb-4360-839f-40b4bb0e8f1f tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-quobyte-6367f0b4-07c5-4ce5-ae87-a44fb9868604" released by "delete_volume" :: held 1.521s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:32 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98e62f84-1bd8-49b7-a1fd-783be72851e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab63fd52-3899-4f16-9296-2263ba993d26', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:32 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af54b4a5-ddd8-49a5-8c83-e883252cf4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:32 devstack sudo[109149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14 Jun 24 10:00:32 devstack sudo[109149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:32 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Volume volume-ab63fd52-3899-4f16-9296-2263ba993d26 (ab63fd52-3899-4f16-9296-2263ba993d26): created successfully Jun 24 10:00:32 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af54b4a5-ddd8-49a5-8c83-e883252cf4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:32 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Flow 'volume_create_manager' (576361a0-e5c3-4462-b685-0bc9fcffdf6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:00:32 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-b25a33b0-4c4c-4be9-9a94-16ae6000c9bf tempest-VolumesDeleteCascade-1955756731 None] Created volume successfully. Jun 24 10:00:32 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-8818cb2b-6cbb-4360-839f-40b4bb0e8f1f tempest-CreateVolumesFromSnapshotTest-1189361087 None] Created reservations ['207974c0-ad5c-4f00-8c62-f5136f512295', '8de7028f-70dc-48ab-ad83-84b5e6bbe99a', 'b3152b96-1fd2-4ae1-bf40-3fbc5a9b4ee3', '90b3a0c6-66f6-4787-b74d-470fdaa4279c'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:00:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8818cb2b-6cbb-4360-839f-40b4bb0e8f1f tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8818cb2b-6cbb-4360-839f-40b4bb0e8f1f tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:32 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8818cb2b-6cbb-4360-839f-40b4bb0e8f1f tempest-CreateVolumesFromSnapshotTest-1189361087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:00:32 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8818cb2b-6cbb-4360-839f-40b4bb0e8f1f tempest-CreateVolumesFromSnapshotTest-1189361087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:00:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8818cb2b-6cbb-4360-839f-40b4bb0e8f1f tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8818cb2b-6cbb-4360-839f-40b4bb0e8f1f tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:32 devstack sudo[109151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:00:32 devstack sudo[109151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:32 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-15a3f727-eb1b-4886-84ed-b661a2d0adcb tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "cinder-e05410ce-097c-43ff-957d-543d3ecba55a-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:32 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-15a3f727-eb1b-4886-84ed-b661a2d0adcb tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-e05410ce-097c-43ff-957d-543d3ecba55a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:32 devstack sudo[109149]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:32 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-15a3f727-eb1b-4886-84ed-b661a2d0adcb tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "cinder-quobyte-e05410ce-097c-43ff-957d-543d3ecba55a" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-08d2ea17-bcc7-480f-bce5-c80527c3e504 tempest-VolumesExtendTest-2143995905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14" returned: 0 in 0.810s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-08d2ea17-bcc7-480f-bce5-c80527c3e504 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.5e351530-2185-45a9-a223-3bce4e4d426b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:32 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-15a3f727-eb1b-4886-84ed-b661a2d0adcb tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-quobyte-e05410ce-097c-43ff-957d-543d3ecba55a" acquired by "delete_volume" :: waited 0.035s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:32 devstack sudo[109157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.5e351530-2185-45a9-a223-3bce4e4d426b Jun 24 10:00:32 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:32 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cff82b-67d1-494d-b463-dfeb1c60a13f]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-15a3f727-eb1b-4886-84ed-b661a2d0adcb tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e05410ce-097c-43ff-957d-543d3ecba55a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:32 devstack sudo[109151]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8818cb2b-6cbb-4360-839f-40b4bb0e8f1f tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.645s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:32 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-8818cb2b-6cbb-4360-839f-40b4bb0e8f1f tempest-CreateVolumesFromSnapshotTest-1189361087 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:00:32 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-8818cb2b-6cbb-4360-839f-40b4bb0e8f1f tempest-CreateVolumesFromSnapshotTest-1189361087 None] Deleted volume successfully. Jun 24 10:00:32 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8818cb2b-6cbb-4360-839f-40b4bb0e8f1f tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-6367f0b4-07c5-4ce5-ae87-a44fb9868604-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:32 devstack sudo[109159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e05410ce-097c-43ff-957d-543d3ecba55a Jun 24 10:00:32 devstack sudo[109159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-08ef92b4-a5bb-4786-87e1-ba3146517361 tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-08ef92b4-a5bb-4786-87e1-ba3146517361 tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-08ef92b4-a5bb-4786-87e1-ba3146517361 tempest-VolumesDeleteCascade-1955756731 None] Creating offline snapshot bedc2e3f-94a4-415a-85eb-c5c2ea54f972 of volume ab63fd52-3899-4f16-9296-2263ba993d26 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 10:00:33 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[46175217-1cf5-4fe4-982b-a390c2f48a7c]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-08ef92b4-a5bb-4786-87e1-ba3146517361 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:33 devstack sudo[109161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26 Jun 24 10:00:33 devstack sudo[109161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:33 devstack sudo[109159]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-15a3f727-eb1b-4886-84ed-b661a2d0adcb tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e05410ce-097c-43ff-957d-543d3ecba55a" returned: 0 in 0.779s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-15a3f727-eb1b-4886-84ed-b661a2d0adcb tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e05410ce-097c-43ff-957d-543d3ecba55a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:33 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-08d2ea17-bcc7-480f-bce5-c80527c3e504 tempest-VolumesExtendTest-2143995905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.5e351530-2185-45a9-a223-3bce4e4d426b" returned: 0 in 0.843s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-08d2ea17-bcc7-480f-bce5-c80527c3e504 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.5e351530-2185-45a9-a223-3bce4e4d426b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:33 devstack sudo[109169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e05410ce-097c-43ff-957d-543d3ecba55a Jun 24 10:00:33 devstack sudo[109169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:33 devstack sudo[109170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.5e351530-2185-45a9-a223-3bce4e4d426b Jun 24 10:00:33 devstack sudo[109170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:34 devstack sudo[109161]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-08ef92b4-a5bb-4786-87e1-ba3146517361 tempest-VolumesDeleteCascade-1955756731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26" returned: 0 in 0.777s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-08ef92b4-a5bb-4786-87e1-ba3146517361 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.bedc2e3f-94a4-415a-85eb-c5c2ea54f972 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:34 devstack sudo[109176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.bedc2e3f-94a4-415a-85eb-c5c2ea54f972 1G Jun 24 10:00:34 devstack sudo[109176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:34 devstack sudo[109169]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-15a3f727-eb1b-4886-84ed-b661a2d0adcb tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e05410ce-097c-43ff-957d-543d3ecba55a" returned: 0 in 0.657s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:34 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-15a3f727-eb1b-4886-84ed-b661a2d0adcb tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-quobyte-e05410ce-097c-43ff-957d-543d3ecba55a" released by "delete_volume" :: held 1.481s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:34 devstack sudo[109170]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-08d2ea17-bcc7-480f-bce5-c80527c3e504 tempest-VolumesExtendTest-2143995905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14.5e351530-2185-45a9-a223-3bce4e4d426b" returned: 0 in 0.683s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:34 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-08d2ea17-bcc7-480f-bce5-c80527c3e504 tempest-VolumesExtendTest-2143995905 None] Lock "cinder-quobyte-5e351530-2185-45a9-a223-3bce4e4d426b" released by "_delete_snapshot" :: held 3.252s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:34 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-08d2ea17-bcc7-480f-bce5-c80527c3e504 tempest-VolumesExtendTest-2143995905 None] Lock "cinder-quobyte-9762df7b-30c7-488d-b342-ae9a96ab1b14" released by "delete_snapshot" :: held 3.287s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:34 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-15a3f727-eb1b-4886-84ed-b661a2d0adcb tempest-CreateVolumesFromSnapshotTest-1189361087 None] Created reservations ['ba4aeeab-8bf9-4478-8b85-c3c8a3efb60b', '6fdb5a6a-6710-4ff8-bd70-4a1d3fdc613b', '3b524cab-fcd8-49db-b315-760bda462b02', 'eb5e0a8b-f804-4549-9f8a-6f6012ea8915'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:00:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-15a3f727-eb1b-4886-84ed-b661a2d0adcb tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-15a3f727-eb1b-4886-84ed-b661a2d0adcb tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:34 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-15a3f727-eb1b-4886-84ed-b661a2d0adcb tempest-CreateVolumesFromSnapshotTest-1189361087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:00:34 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-15a3f727-eb1b-4886-84ed-b661a2d0adcb tempest-CreateVolumesFromSnapshotTest-1189361087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:00:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-15a3f727-eb1b-4886-84ed-b661a2d0adcb tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-15a3f727-eb1b-4886-84ed-b661a2d0adcb tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:34 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-08d2ea17-bcc7-480f-bce5-c80527c3e504 tempest-VolumesExtendTest-2143995905 None] Created reservations ['51ec0e8b-ee1c-4e33-8e63-d663e3ab176f', '80bc048a-5b2f-402a-b066-f054f1c34229', 'e87cc7f1-faff-43db-b4c2-9d7aebcfc517', '0bb7574e-fd07-4d14-9687-c475e4883f26'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:00:34 devstack sudo[109180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:00:34 devstack sudo[109180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:34 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-08d2ea17-bcc7-480f-bce5-c80527c3e504 tempest-VolumesExtendTest-2143995905 None] Delete snapshot completed successfully. Jun 24 10:00:34 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-08d2ea17-bcc7-480f-bce5-c80527c3e504 tempest-VolumesExtendTest-2143995905 None] Lock "cinder-5e351530-2185-45a9-a223-3bce4e4d426b-delete_snapshot" released by "delete_snapshot" :: held 3.493s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:34 devstack sudo[109176]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-08ef92b4-a5bb-4786-87e1-ba3146517361 tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.bedc2e3f-94a4-415a-85eb-c5c2ea54f972 1G" returned: 0 in 0.817s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-08ef92b4-a5bb-4786-87e1-ba3146517361 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab63fd52-3899-4f16-9296-2263ba993d26 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.bedc2e3f-94a4-415a-85eb-c5c2ea54f972 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:34 devstack sudo[109185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab63fd52-3899-4f16-9296-2263ba993d26 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.bedc2e3f-94a4-415a-85eb-c5c2ea54f972 Jun 24 10:00:34 devstack sudo[109185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:34 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-20c1f81e-1bdd-4d31-9de6-63f084bd175e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "cinder-0a4e15f3-a089-4138-accf-a96f462db09f-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:34 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-20c1f81e-1bdd-4d31-9de6-63f084bd175e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-0a4e15f3-a089-4138-accf-a96f462db09f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:34 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-20c1f81e-1bdd-4d31-9de6-63f084bd175e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "cinder-quobyte-0a4e15f3-a089-4138-accf-a96f462db09f" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:35 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-20c1f81e-1bdd-4d31-9de6-63f084bd175e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-quobyte-0a4e15f3-a089-4138-accf-a96f462db09f" acquired by "delete_volume" :: waited 0.019s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:35 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e60a485-f65d-401d-b7ad-f6782c8d591f]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-20c1f81e-1bdd-4d31-9de6-63f084bd175e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0a4e15f3-a089-4138-accf-a96f462db09f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:35 devstack sudo[109188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0a4e15f3-a089-4138-accf-a96f462db09f Jun 24 10:00:35 devstack sudo[109180]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:35 devstack sudo[109188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-15a3f727-eb1b-4886-84ed-b661a2d0adcb tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.743s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:35 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-15a3f727-eb1b-4886-84ed-b661a2d0adcb tempest-CreateVolumesFromSnapshotTest-1189361087 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:00:35 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-15a3f727-eb1b-4886-84ed-b661a2d0adcb tempest-CreateVolumesFromSnapshotTest-1189361087 None] Deleted volume successfully. Jun 24 10:00:35 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-15a3f727-eb1b-4886-84ed-b661a2d0adcb tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-e05410ce-097c-43ff-957d-543d3ecba55a-delete_volume" released by "delete_volume" :: held 2.528s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:35 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9e015de0-6e63-4c6b-8acc-649ed4a77f74 tempest-VolumesExtendTest-2143995905 None] Acquiring lock "cinder-9762df7b-30c7-488d-b342-ae9a96ab1b14-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:35 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9e015de0-6e63-4c6b-8acc-649ed4a77f74 tempest-VolumesExtendTest-2143995905 None] Lock "cinder-9762df7b-30c7-488d-b342-ae9a96ab1b14-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:35 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9e015de0-6e63-4c6b-8acc-649ed4a77f74 tempest-VolumesExtendTest-2143995905 None] Acquiring lock "cinder-quobyte-9762df7b-30c7-488d-b342-ae9a96ab1b14" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:35 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9e015de0-6e63-4c6b-8acc-649ed4a77f74 tempest-VolumesExtendTest-2143995905 None] Lock "cinder-quobyte-9762df7b-30c7-488d-b342-ae9a96ab1b14" acquired by "delete_volume" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:35 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[da79d22e-c23a-4b29-bead-5e97927e8b85]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9e015de0-6e63-4c6b-8acc-649ed4a77f74 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:35 devstack sudo[109185]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-08ef92b4-a5bb-4786-87e1-ba3146517361 tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab63fd52-3899-4f16-9296-2263ba993d26 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.bedc2e3f-94a4-415a-85eb-c5c2ea54f972" returned: 0 in 0.727s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:35 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-08ef92b4-a5bb-4786-87e1-ba3146517361 tempest-VolumesDeleteCascade-1955756731 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.bedc2e3f-94a4-415a-85eb-c5c2ea54f972 is being set with open permissions: ugo+rw Jun 24 10:00:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-08ef92b4-a5bb-4786-87e1-ba3146517361 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.bedc2e3f-94a4-415a-85eb-c5c2ea54f972 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:35 devstack sudo[109193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14 Jun 24 10:00:35 devstack sudo[109193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:35 devstack sudo[109194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.bedc2e3f-94a4-415a-85eb-c5c2ea54f972 Jun 24 10:00:35 devstack sudo[109194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:35 devstack sudo[109188]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-20c1f81e-1bdd-4d31-9de6-63f084bd175e tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0a4e15f3-a089-4138-accf-a96f462db09f" returned: 0 in 0.836s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-20c1f81e-1bdd-4d31-9de6-63f084bd175e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0a4e15f3-a089-4138-accf-a96f462db09f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:35 devstack sudo[109200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0a4e15f3-a089-4138-accf-a96f462db09f Jun 24 10:00:35 devstack sudo[109200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:36 devstack sudo[109194]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-08ef92b4-a5bb-4786-87e1-ba3146517361 tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.bedc2e3f-94a4-415a-85eb-c5c2ea54f972" returned: 0 in 0.671s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-08ef92b4-a5bb-4786-87e1-ba3146517361 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:36 devstack sudo[109193]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9e015de0-6e63-4c6b-8acc-649ed4a77f74 tempest-VolumesExtendTest-2143995905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14" returned: 0 in 0.822s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9e015de0-6e63-4c6b-8acc-649ed4a77f74 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:36 devstack sudo[109206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.info Jun 24 10:00:36 devstack sudo[109206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:36 devstack sudo[109207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14 Jun 24 10:00:36 devstack sudo[109207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:36 devstack sudo[109200]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-20c1f81e-1bdd-4d31-9de6-63f084bd175e tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0a4e15f3-a089-4138-accf-a96f462db09f" returned: 0 in 0.690s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-20c1f81e-1bdd-4d31-9de6-63f084bd175e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-quobyte-0a4e15f3-a089-4138-accf-a96f462db09f" released by "delete_volume" :: held 1.570s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:36 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-20c1f81e-1bdd-4d31-9de6-63f084bd175e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Created reservations ['b89de32e-ae4c-4648-81f2-dec690262248', '9a32440b-0d47-4cfd-8dd7-1f100045ca36', 'e7db80f8-deb4-4187-8920-d4ad0adff250', '8b68e4be-a718-48ec-828d-25dfa3e0fccd'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:00:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-20c1f81e-1bdd-4d31-9de6-63f084bd175e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-20c1f81e-1bdd-4d31-9de6-63f084bd175e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-20c1f81e-1bdd-4d31-9de6-63f084bd175e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:00:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-20c1f81e-1bdd-4d31-9de6-63f084bd175e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:00:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-20c1f81e-1bdd-4d31-9de6-63f084bd175e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-20c1f81e-1bdd-4d31-9de6-63f084bd175e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:36 devstack sudo[109211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:00:36 devstack sudo[109211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:36 devstack sudo[109207]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9e015de0-6e63-4c6b-8acc-649ed4a77f74 tempest-VolumesExtendTest-2143995905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9762df7b-30c7-488d-b342-ae9a96ab1b14" returned: 0 in 0.698s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:36 devstack sudo[109206]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-08ef92b4-a5bb-4786-87e1-ba3146517361 tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.info" returned: 0 in 0.728s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:36 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-08ef92b4-a5bb-4786-87e1-ba3146517361 tempest-VolumesDeleteCascade-1955756731 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.info is being set with open permissions: ugo+rw Jun 24 10:00:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-08ef92b4-a5bb-4786-87e1-ba3146517361 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:37 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9e015de0-6e63-4c6b-8acc-649ed4a77f74 tempest-VolumesExtendTest-2143995905 None] Lock "cinder-quobyte-9762df7b-30c7-488d-b342-ae9a96ab1b14" released by "delete_volume" :: held 1.599s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:37 devstack sudo[109215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.info Jun 24 10:00:37 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:37 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-9e015de0-6e63-4c6b-8acc-649ed4a77f74 tempest-VolumesExtendTest-2143995905 None] Created reservations ['10f8292f-55d2-4137-8025-d17c24b6b7a6', 'b920cce8-4f4a-4268-9c78-ae239cb926b8', '374d2c25-1efa-48ce-9b19-145a32cf2d97', 'a1bb66bd-3927-4f7c-b934-7dede109293f'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:00:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9e015de0-6e63-4c6b-8acc-649ed4a77f74 tempest-VolumesExtendTest-2143995905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9e015de0-6e63-4c6b-8acc-649ed4a77f74 tempest-VolumesExtendTest-2143995905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:37 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9e015de0-6e63-4c6b-8acc-649ed4a77f74 tempest-VolumesExtendTest-2143995905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:00:37 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9e015de0-6e63-4c6b-8acc-649ed4a77f74 tempest-VolumesExtendTest-2143995905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:00:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9e015de0-6e63-4c6b-8acc-649ed4a77f74 tempest-VolumesExtendTest-2143995905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9e015de0-6e63-4c6b-8acc-649ed4a77f74 tempest-VolumesExtendTest-2143995905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:37 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fdd20dd8-b9f8-41cc-9573-9c4174c97f4e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "cinder-413be76e-ece6-4f63-a620-fb2bc3ad05e5-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:37 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fdd20dd8-b9f8-41cc-9573-9c4174c97f4e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-413be76e-ece6-4f63-a620-fb2bc3ad05e5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:37 devstack sudo[109217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:00:37 devstack sudo[109217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:37 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fdd20dd8-b9f8-41cc-9573-9c4174c97f4e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "cinder-quobyte-413be76e-ece6-4f63-a620-fb2bc3ad05e5" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:37 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fdd20dd8-b9f8-41cc-9573-9c4174c97f4e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-quobyte-413be76e-ece6-4f63-a620-fb2bc3ad05e5" acquired by "delete_volume" :: waited 0.031s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:37 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[db19c001-6967-4852-960e-627a83ddffec]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fdd20dd8-b9f8-41cc-9573-9c4174c97f4e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-413be76e-ece6-4f63-a620-fb2bc3ad05e5 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:37 devstack sudo[109211]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-20c1f81e-1bdd-4d31-9de6-63f084bd175e tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.732s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:37 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-20c1f81e-1bdd-4d31-9de6-63f084bd175e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:00:37 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-20c1f81e-1bdd-4d31-9de6-63f084bd175e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Deleted volume successfully. Jun 24 10:00:37 devstack sudo[109220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-413be76e-ece6-4f63-a620-fb2bc3ad05e5 Jun 24 10:00:37 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:37 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-20c1f81e-1bdd-4d31-9de6-63f084bd175e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-0a4e15f3-a089-4138-accf-a96f462db09f-delete_volume" released by "delete_volume" :: held 2.546s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:37 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-08ef92b4-a5bb-4786-87e1-ba3146517361 tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.info" returned: 0 in 0.757s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-08ef92b4-a5bb-4786-87e1-ba3146517361 tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.590s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:37 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-08ef92b4-a5bb-4786-87e1-ba3146517361 tempest-VolumesDeleteCascade-1955756731 None] Create snapshot completed successfully Jun 24 10:00:37 devstack sudo[109217]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9e015de0-6e63-4c6b-8acc-649ed4a77f74 tempest-VolumesExtendTest-2143995905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.822s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:37 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-9e015de0-6e63-4c6b-8acc-649ed4a77f74 tempest-VolumesExtendTest-2143995905 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:00:37 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-9e015de0-6e63-4c6b-8acc-649ed4a77f74 tempest-VolumesExtendTest-2143995905 None] Deleted volume successfully. Jun 24 10:00:38 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9e015de0-6e63-4c6b-8acc-649ed4a77f74 tempest-VolumesExtendTest-2143995905 None] Lock "cinder-9762df7b-30c7-488d-b342-ae9a96ab1b14-delete_volume" released by "delete_volume" :: held 2.660s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:38 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fdd20dd8-b9f8-41cc-9573-9c4174c97f4e tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-413be76e-ece6-4f63-a620-fb2bc3ad05e5" returned: 0 in 0.836s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fdd20dd8-b9f8-41cc-9573-9c4174c97f4e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-413be76e-ece6-4f63-a620-fb2bc3ad05e5 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:38 devstack sudo[109228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-413be76e-ece6-4f63-a620-fb2bc3ad05e5 Jun 24 10:00:38 devstack sudo[109228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:38 devstack sudo[109228]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fdd20dd8-b9f8-41cc-9573-9c4174c97f4e tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-413be76e-ece6-4f63-a620-fb2bc3ad05e5" returned: 0 in 0.753s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:38 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fdd20dd8-b9f8-41cc-9573-9c4174c97f4e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-quobyte-413be76e-ece6-4f63-a620-fb2bc3ad05e5" released by "delete_volume" :: held 1.658s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-fdd20dd8-b9f8-41cc-9573-9c4174c97f4e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Created reservations ['542acee7-69a0-414c-b178-8797b379c463', 'ab9f853b-b364-4a56-bfd8-1e58a60e8f50', 'a5e01087-db19-4712-8199-57db074c4e3d', 'cbe70f29-845b-465e-92de-ce23d902e4cd'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Flow 'volume_create_manager' (6166cf88-cd20-49e6-aa5b-ffc800cbbdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c562fe-b8b4-406a-9605-2c6458a15fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c562fe-b8b4-406a-9605-2c6458a15fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1026517827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07d1c6b9-a949-4c7b-a560-17d7e3430f62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c96dbc2789b244e1b675855ac7ab30df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bedc2e3f-94a4-415a-85eb-c5c2ea54f972,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:00:39Z,use_quota=True,user_id='df405c3b00834038a0a6f3c844b3ccdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ba3c2e-593e-407d-aad8-6eb15babccbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ba3c2e-593e-407d-aad8-6eb15babccbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa13d2d-8729-44e0-bb45-5bcaadad4e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa13d2d-8729-44e0-bb45-5bcaadad4e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '07d1c6b9-a949-4c7b-a560-17d7e3430f62', 'volume_name': 'volume-07d1c6b9-a949-4c7b-a560-17d7e3430f62', 'volume_size': 1, 'snapshot_id': 'bedc2e3f-94a4-415a-85eb-c5c2ea54f972'}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31d4526-8456-417a-a361-d9f8ebf2920f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31d4526-8456-417a-a361-d9f8ebf2920f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08f907f-237f-41e9-9cce-3301b474b0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:39 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Volume 07d1c6b9-a949-4c7b-a560-17d7e3430f62: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-07d1c6b9-a949-4c7b-a560-17d7e3430f62', 'volume_size': 1, 'snapshot_id': 'bedc2e3f-94a4-415a-85eb-c5c2ea54f972'} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "cinder-quobyte-bedc2e3f-94a4-415a-85eb-c5c2ea54f972-07d1c6b9-a949-4c7b-a560-17d7e3430f62" by "_create_volume_from_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-quobyte-bedc2e3f-94a4-415a-85eb-c5c2ea54f972-07d1c6b9-a949-4c7b-a560-17d7e3430f62" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Creating volume 07d1c6b9-a949-4c7b-a560-17d7e3430f62 from snapshot bedc2e3f-94a4-415a-85eb-c5c2ea54f972 {{(pid=93447) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "cinder-quobyte-07d1c6b9-a949-4c7b-a560-17d7e3430f62" by "_copy_volume_from_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-fdd20dd8-b9f8-41cc-9573-9c4174c97f4e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-fdd20dd8-b9f8-41cc-9573-9c4174c97f4e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-fdd20dd8-b9f8-41cc-9573-9c4174c97f4e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-fdd20dd8-b9f8-41cc-9573-9c4174c97f4e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-fdd20dd8-b9f8-41cc-9573-9c4174c97f4e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fdd20dd8-b9f8-41cc-9573-9c4174c97f4e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-quobyte-07d1c6b9-a949-4c7b-a560-17d7e3430f62" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] snapshot: bedc2e3f-94a4-415a-85eb-c5c2ea54f972, volume: 07d1c6b9-a949-4c7b-a560-17d7e3430f62, {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 10:00:39 devstack sudo[109231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:00:39 devstack sudo[109231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7bcb3b-b27e-4b41-a07a-ab575cd8e0cf]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.bedc2e3f-94a4-415a-85eb-c5c2ea54f972 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:39 devstack sudo[109233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.bedc2e3f-94a4-415a-85eb-c5c2ea54f972 Jun 24 10:00:39 devstack sudo[109233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e17a64b0-e366-4ae5-b6ff-b8e9fb04e4a6 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "cinder-d3139f54-041a-4436-a1ac-30f4f583018d-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e17a64b0-e366-4ae5-b6ff-b8e9fb04e4a6 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-d3139f54-041a-4436-a1ac-30f4f583018d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e17a64b0-e366-4ae5-b6ff-b8e9fb04e4a6 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "cinder-quobyte-d3139f54-041a-4436-a1ac-30f4f583018d" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e17a64b0-e366-4ae5-b6ff-b8e9fb04e4a6 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-quobyte-d3139f54-041a-4436-a1ac-30f4f583018d" acquired by "delete_volume" :: waited 0.014s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[09293d84-8fca-4eb8-992b-caf4cf72125d]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e17a64b0-e366-4ae5-b6ff-b8e9fb04e4a6 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d3139f54-041a-4436-a1ac-30f4f583018d {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:39 devstack sudo[109235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d3139f54-041a-4436-a1ac-30f4f583018d Jun 24 10:00:39 devstack sudo[109235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:39 devstack sudo[109231]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fdd20dd8-b9f8-41cc-9573-9c4174c97f4e tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.761s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:40 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-fdd20dd8-b9f8-41cc-9573-9c4174c97f4e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:00:40 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-fdd20dd8-b9f8-41cc-9573-9c4174c97f4e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Deleted volume successfully. Jun 24 10:00:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fdd20dd8-b9f8-41cc-9573-9c4174c97f4e tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-413be76e-ece6-4f63-a620-fb2bc3ad05e5-delete_volume" released by "delete_volume" :: held 2.850s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:40 devstack sudo[109233]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.bedc2e3f-94a4-415a-85eb-c5c2ea54f972" returned: 0 in 0.931s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab63fd52-3899-4f16-9296-2263ba993d26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:00:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26 {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 10:00:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Creating direct copy from snapshot {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 10:00:40 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e794d1d4-c1ff-4062-8eb1-e770a7120902]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:40 devstack sudo[109241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26 Jun 24 10:00:40 devstack sudo[109241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:40 devstack sudo[109235]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e17a64b0-e366-4ae5-b6ff-b8e9fb04e4a6 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d3139f54-041a-4436-a1ac-30f4f583018d" returned: 0 in 0.976s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e17a64b0-e366-4ae5-b6ff-b8e9fb04e4a6 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d3139f54-041a-4436-a1ac-30f4f583018d {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:40 devstack sudo[109248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d3139f54-041a-4436-a1ac-30f4f583018d Jun 24 10:00:40 devstack sudo[109248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:41 devstack sudo[109241]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26" returned: 0 in 0.910s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:41 devstack cinder-volume[93447]: DEBUG cinder.utils [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Path /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-07d1c6b9-a949-4c7b-a560-17d7e3430f62 not found in is_blk_device check {{(pid=93447) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 10:00:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-07d1c6b9-a949-4c7b-a560-17d7e3430f62 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:41 devstack sudo[109253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-07d1c6b9-a949-4c7b-a560-17d7e3430f62 Jun 24 10:00:41 devstack sudo[109253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:41 devstack sudo[109248]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e17a64b0-e366-4ae5-b6ff-b8e9fb04e4a6 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d3139f54-041a-4436-a1ac-30f4f583018d" returned: 0 in 0.737s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e17a64b0-e366-4ae5-b6ff-b8e9fb04e4a6 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-quobyte-d3139f54-041a-4436-a1ac-30f4f583018d" released by "delete_volume" :: held 1.770s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:41 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-e17a64b0-e366-4ae5-b6ff-b8e9fb04e4a6 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Created reservations ['02cbfd7a-af02-4260-b957-6c7bd7691e74', '5ff75318-0ad4-4da7-a953-69d5890fc526', 'b02d6838-a159-41a3-b6cb-0d4042222dac', 'cc798f02-f018-4798-965a-165d1e5f13f2'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:00:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e17a64b0-e366-4ae5-b6ff-b8e9fb04e4a6 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e17a64b0-e366-4ae5-b6ff-b8e9fb04e4a6 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:41 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-e17a64b0-e366-4ae5-b6ff-b8e9fb04e4a6 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:00:41 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-e17a64b0-e366-4ae5-b6ff-b8e9fb04e4a6 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:00:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e17a64b0-e366-4ae5-b6ff-b8e9fb04e4a6 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e17a64b0-e366-4ae5-b6ff-b8e9fb04e4a6 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:41 devstack sudo[109256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:00:41 devstack sudo[109256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b58805c8-bb9f-4c9a-9e8a-86da59723f01 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "cinder-6d839686-1e5a-4385-9300-f0d70e771595-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b58805c8-bb9f-4c9a-9e8a-86da59723f01 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-6d839686-1e5a-4385-9300-f0d70e771595-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b58805c8-bb9f-4c9a-9e8a-86da59723f01 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "cinder-quobyte-8c52018d-c4e7-462c-8246-f95e0991d964" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b58805c8-bb9f-4c9a-9e8a-86da59723f01 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-quobyte-8c52018d-c4e7-462c-8246-f95e0991d964" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b58805c8-bb9f-4c9a-9e8a-86da59723f01 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "cinder-quobyte-6d839686-1e5a-4385-9300-f0d70e771595" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b58805c8-bb9f-4c9a-9e8a-86da59723f01 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-quobyte-6d839686-1e5a-4385-9300-f0d70e771595" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:41 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-b58805c8-bb9f-4c9a-9e8a-86da59723f01 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Deleting offline snapshot 6d839686-1e5a-4385-9300-f0d70e771595 of volume 8c52018d-c4e7-462c-8246-f95e0991d964 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 10:00:41 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-b58805c8-bb9f-4c9a-9e8a-86da59723f01 tempest-CreateVolumesFromSnapshotTest-1189361087 None] snapshot_file for this snap is: volume-8c52018d-c4e7-462c-8246-f95e0991d964.6d839686-1e5a-4385-9300-f0d70e771595 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 10:00:41 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ea741b-51cf-43e5-a0ac-ec086e0bfbb4]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b58805c8-bb9f-4c9a-9e8a-86da59723f01 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.6d839686-1e5a-4385-9300-f0d70e771595 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:42 devstack sudo[109259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.6d839686-1e5a-4385-9300-f0d70e771595 Jun 24 10:00:42 devstack sudo[109259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:42 devstack sudo[109256]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e17a64b0-e366-4ae5-b6ff-b8e9fb04e4a6 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.907s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:42 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-e17a64b0-e366-4ae5-b6ff-b8e9fb04e4a6 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:00:42 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-e17a64b0-e366-4ae5-b6ff-b8e9fb04e4a6 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Deleted volume successfully. Jun 24 10:00:42 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e17a64b0-e366-4ae5-b6ff-b8e9fb04e4a6 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-d3139f54-041a-4436-a1ac-30f4f583018d-delete_volume" released by "delete_volume" :: held 2.976s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:43 devstack sudo[109259]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b58805c8-bb9f-4c9a-9e8a-86da59723f01 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.6d839686-1e5a-4385-9300-f0d70e771595" returned: 0 in 1.332s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:43 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-b58805c8-bb9f-4c9a-9e8a-86da59723f01 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c52018d-c4e7-462c-8246-f95e0991d964(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:00:43 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb5bdb8-0914-4fac-99b6-07ff20a1dffd]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b58805c8-bb9f-4c9a-9e8a-86da59723f01 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:43 devstack sudo[109275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964 Jun 24 10:00:43 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:44 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b58805c8-bb9f-4c9a-9e8a-86da59723f01 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964" returned: 0 in 1.622s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b58805c8-bb9f-4c9a-9e8a-86da59723f01 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.6d839686-1e5a-4385-9300-f0d70e771595 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:45 devstack sudo[109280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.6d839686-1e5a-4385-9300-f0d70e771595 Jun 24 10:00:45 devstack sudo[109280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:46 devstack sudo[109280]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b58805c8-bb9f-4c9a-9e8a-86da59723f01 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.6d839686-1e5a-4385-9300-f0d70e771595" returned: 0 in 1.965s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b58805c8-bb9f-4c9a-9e8a-86da59723f01 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.6d839686-1e5a-4385-9300-f0d70e771595 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:47 devstack sudo[109287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.6d839686-1e5a-4385-9300-f0d70e771595 Jun 24 10:00:47 devstack sudo[109287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:47 devstack sudo[109253]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-07d1c6b9-a949-4c7b-a560-17d7e3430f62" returned: 0 in 6.218s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:47 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c31e2c-f05a-4154-bb8a-9085503f5fa7]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:47 devstack sudo[109289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26 Jun 24 10:00:47 devstack sudo[109289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:47 devstack sudo[109287]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b58805c8-bb9f-4c9a-9e8a-86da59723f01 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964.6d839686-1e5a-4385-9300-f0d70e771595" returned: 0 in 0.832s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b58805c8-bb9f-4c9a-9e8a-86da59723f01 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-quobyte-6d839686-1e5a-4385-9300-f0d70e771595" released by "_delete_snapshot" :: held 5.968s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b58805c8-bb9f-4c9a-9e8a-86da59723f01 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-quobyte-8c52018d-c4e7-462c-8246-f95e0991d964" released by "delete_snapshot" :: held 6.009s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:47 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-b58805c8-bb9f-4c9a-9e8a-86da59723f01 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Created reservations ['f851c4f9-325e-4d9a-924b-86fe5bea6bd4', 'f2de9411-609d-4718-b257-0b88e8c22883', 'b83614f1-b150-4109-9638-f98ca89c67f7', '3dc1a6c0-5ac7-49e2-9161-1a54e30290a4'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:00:48 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-b58805c8-bb9f-4c9a-9e8a-86da59723f01 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Delete snapshot completed successfully. Jun 24 10:00:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b58805c8-bb9f-4c9a-9e8a-86da59723f01 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-6d839686-1e5a-4385-9300-f0d70e771595-delete_snapshot" released by "delete_snapshot" :: held 6.206s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f712436d-1571-4000-907f-47db82229253 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "cinder-8c52018d-c4e7-462c-8246-f95e0991d964-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f712436d-1571-4000-907f-47db82229253 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-8c52018d-c4e7-462c-8246-f95e0991d964-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f712436d-1571-4000-907f-47db82229253 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "cinder-quobyte-8c52018d-c4e7-462c-8246-f95e0991d964" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f712436d-1571-4000-907f-47db82229253 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-quobyte-8c52018d-c4e7-462c-8246-f95e0991d964" acquired by "delete_volume" :: waited 0.024s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:48 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29729f3-4fda-477e-b18b-64dbc6e44402]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f712436d-1571-4000-907f-47db82229253 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:48 devstack sudo[109294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964 Jun 24 10:00:48 devstack sudo[109294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:48 devstack sudo[109289]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26" returned: 0 in 1.208s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:48 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-07d1c6b9-a949-4c7b-a560-17d7e3430f62 {{(pid=93447) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 10:00:48 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Converted 1024.00 MB image at 164.64 MB/s Jun 24 10:00:48 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-07d1c6b9-a949-4c7b-a560-17d7e3430f62 is being set with open permissions: ugo+rw Jun 24 10:00:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-07d1c6b9-a949-4c7b-a560-17d7e3430f62 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:48 devstack sudo[109297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-07d1c6b9-a949-4c7b-a560-17d7e3430f62 Jun 24 10:00:48 devstack sudo[109297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:49 devstack sudo[109297]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:49 devstack sudo[109294]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-07d1c6b9-a949-4c7b-a560-17d7e3430f62" returned: 0 in 0.707s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f712436d-1571-4000-907f-47db82229253 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964" returned: 0 in 0.849s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f712436d-1571-4000-907f-47db82229253 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:49 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-quobyte-07d1c6b9-a949-4c7b-a560-17d7e3430f62" released by "_copy_volume_from_snapshot" :: held 10.097s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:49 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-quobyte-bedc2e3f-94a4-415a-85eb-c5c2ea54f972-07d1c6b9-a949-4c7b-a560-17d7e3430f62" released by "_create_volume_from_snapshot" :: held 10.157s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.176s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:49 devstack sudo[109304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964 Jun 24 10:00:49 devstack sudo[109304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:49 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08f907f-237f-41e9-9cce-3301b474b0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07d1c6b9-a949-4c7b-a560-17d7e3430f62', 'volume_size': 1, 'snapshot_id': 'bedc2e3f-94a4-415a-85eb-c5c2ea54f972'}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:49 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cb2f7e4-3ef2-4496-872c-9b3f7af7f5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:49 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Volume volume-07d1c6b9-a949-4c7b-a560-17d7e3430f62 (07d1c6b9-a949-4c7b-a560-17d7e3430f62): created successfully Jun 24 10:00:49 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cb2f7e4-3ef2-4496-872c-9b3f7af7f5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:49 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Flow 'volume_create_manager' (6166cf88-cd20-49e6-aa5b-ffc800cbbdcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:00:49 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-ffc4929d-6e34-48bf-8c8b-3900c841cee3 tempest-VolumesDeleteCascade-1955756731 None] Created volume successfully. Jun 24 10:00:50 devstack sudo[109304]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f712436d-1571-4000-907f-47db82229253 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8c52018d-c4e7-462c-8246-f95e0991d964" returned: 0 in 0.676s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f712436d-1571-4000-907f-47db82229253 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-quobyte-8c52018d-c4e7-462c-8246-f95e0991d964" released by "delete_volume" :: held 1.611s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:50 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-f712436d-1571-4000-907f-47db82229253 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Created reservations ['6c07d660-bd67-4731-8e36-8074190afe04', 'a2ed584b-3bb4-4922-928d-b87712ef24cc', '51c48906-b56e-445f-8fa6-9f8353a46fcc', 'e55ec35d-6830-46da-8445-9349016de2f1'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:00:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f712436d-1571-4000-907f-47db82229253 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f712436d-1571-4000-907f-47db82229253 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f712436d-1571-4000-907f-47db82229253 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:00:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f712436d-1571-4000-907f-47db82229253 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:00:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f712436d-1571-4000-907f-47db82229253 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f712436d-1571-4000-907f-47db82229253 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:50 devstack sudo[109307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:00:50 devstack sudo[109307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "cinder-ab63fd52-3899-4f16-9296-2263ba993d26-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-ab63fd52-3899-4f16-9296-2263ba993d26-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:50 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Performing cascade delete. {{(pid=93447) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 24 10:00:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "cinder-bedc2e3f-94a4-415a-85eb-c5c2ea54f972-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-bedc2e3f-94a4-415a-85eb-c5c2ea54f972-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "cinder-quobyte-ab63fd52-3899-4f16-9296-2263ba993d26" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-quobyte-ab63fd52-3899-4f16-9296-2263ba993d26" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "cinder-quobyte-bedc2e3f-94a4-415a-85eb-c5c2ea54f972" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-quobyte-bedc2e3f-94a4-415a-85eb-c5c2ea54f972" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Deleting offline snapshot bedc2e3f-94a4-415a-85eb-c5c2ea54f972 of volume ab63fd52-3899-4f16-9296-2263ba993d26 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 10:00:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] snapshot_file for this snap is: volume-ab63fd52-3899-4f16-9296-2263ba993d26.bedc2e3f-94a4-415a-85eb-c5c2ea54f972 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 10:00:50 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ba7730-8eb2-485f-b9c6-ea2e7aeda2cc]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.bedc2e3f-94a4-415a-85eb-c5c2ea54f972 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:50 devstack sudo[109309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.bedc2e3f-94a4-415a-85eb-c5c2ea54f972 Jun 24 10:00:50 devstack sudo[109309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:51 devstack sudo[109307]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f712436d-1571-4000-907f-47db82229253 tempest-CreateVolumesFromSnapshotTest-1189361087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.822s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:51 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-f712436d-1571-4000-907f-47db82229253 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:00:51 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-f712436d-1571-4000-907f-47db82229253 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Deleted volume successfully. Jun 24 10:00:51 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f712436d-1571-4000-907f-47db82229253 tempest-CreateVolumesFromSnapshotTest-1189361087 None] Lock "cinder-8c52018d-c4e7-462c-8246-f95e0991d964-delete_volume" released by "delete_volume" :: held 2.712s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:51 devstack sudo[109309]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.bedc2e3f-94a4-415a-85eb-c5c2ea54f972" returned: 0 in 0.917s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:51 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab63fd52-3899-4f16-9296-2263ba993d26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:00:51 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c3c1f0-3616-4dd5-bbf6-4debdd597c41]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:51 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26 Jun 24 10:00:51 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:52 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26" returned: 0 in 0.874s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.bedc2e3f-94a4-415a-85eb-c5c2ea54f972 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:52 devstack sudo[109324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.bedc2e3f-94a4-415a-85eb-c5c2ea54f972 Jun 24 10:00:52 devstack sudo[109324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:53 devstack sudo[109324]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.bedc2e3f-94a4-415a-85eb-c5c2ea54f972" returned: 0 in 0.921s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.bedc2e3f-94a4-415a-85eb-c5c2ea54f972 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:53 devstack sudo[109330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.bedc2e3f-94a4-415a-85eb-c5c2ea54f972 Jun 24 10:00:53 devstack sudo[109330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:54 devstack sudo[109330]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26.bedc2e3f-94a4-415a-85eb-c5c2ea54f972" returned: 0 in 0.915s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:54 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-quobyte-bedc2e3f-94a4-415a-85eb-c5c2ea54f972" released by "_delete_snapshot" :: held 3.776s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:54 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-quobyte-ab63fd52-3899-4f16-9296-2263ba993d26" released by "delete_snapshot" :: held 3.808s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:54 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Created reservations ['9d860a44-4981-426f-9b98-78beb899fa48', '43d1cbc3-1607-4f4e-96b3-bc3320fa3ece', '23ae159c-c7b5-4670-a605-7e4b125963de', 'fc1101d8-f560-42b0-90c0-ec4b74d839b0'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:00:54 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Delete snapshot completed successfully. Jun 24 10:00:54 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-bedc2e3f-94a4-415a-85eb-c5c2ea54f972-delete_snapshot" released by "delete_snapshot" :: held 4.001s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Snapshots deleted, issuing volume delete {{(pid=93447) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 24 10:00:54 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "cinder-quobyte-ab63fd52-3899-4f16-9296-2263ba993d26" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:54 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-quobyte-ab63fd52-3899-4f16-9296-2263ba993d26" acquired by "delete_volume" :: waited 0.019s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:54 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7dcdc9c-e0fa-4ab4-8f53-712ece392b27]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:54 devstack sudo[109335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26 Jun 24 10:00:54 devstack sudo[109335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:55 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:00:55 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Flow 'volume_create_manager' (d0c7fe1c-95c0-4cbb-857d-1a4a74d17f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:00:55 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716c49a7-fa0c-484d-8b85-dd0b781611fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:55 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716c49a7-fa0c-484d-8b85-dd0b781611fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1233930181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544f46a8-3587-40e9-b69e-7b7cfc25eb8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89229ce502b54ba6b5d7e77368f48d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:00:55Z,use_quota=True,user_id='cd3616fb82f34fc7aee1a2da76b3d4f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:55 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01b1c23-8218-4d33-b95c-138ee01a67c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:55 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01b1c23-8218-4d33-b95c-138ee01a67c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:55 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2235ee2a-0c60-4329-8d84-4179e2ccbe60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:55 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2235ee2a-0c60-4329-8d84-4179e2ccbe60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '544f46a8-3587-40e9-b69e-7b7cfc25eb8d', 'volume_name': 'volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:55 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9b54d8-a1fc-4543-bdd9-42db011e7991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:55 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9b54d8-a1fc-4543-bdd9-42db011e7991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:55 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c14181-1dff-4d21-8357-ab188394449d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:55 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Volume 544f46a8-3587-40e9-b69e-7b7cfc25eb8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d', 'volume_size': 1} Jun 24 10:00:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:55 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1233930181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544f46a8-3587-40e9-b69e-7b7cfc25eb8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89229ce502b54ba6b5d7e77368f48d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:00:55Z,use_quota=True,user_id='cd3616fb82f34fc7aee1a2da76b3d4f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:00:55 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Creating volume 544f46a8-3587-40e9-b69e-7b7cfc25eb8d {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:00:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:55 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:00:55 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:00:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:55 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:00:55 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:00:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:55 devstack sudo[109337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d 1073741824 Jun 24 10:00:55 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:55 devstack sudo[109335]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26" returned: 0 in 0.851s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:55 devstack sudo[109342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26 Jun 24 10:00:55 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:56 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ab63fd52-3899-4f16-9296-2263ba993d26" returned: 0 in 0.681s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:56 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:56 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-quobyte-ab63fd52-3899-4f16-9296-2263ba993d26" released by "delete_volume" :: held 1.599s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d 1073741824" returned: 0 in 0.943s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:56 devstack sudo[109349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d Jun 24 10:00:56 devstack sudo[109349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:56 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Created reservations ['9fa74c16-ca65-4887-9d04-654cacd2b2eb', '60137a1d-6eb0-433d-b5a8-d1f066ec5356', 'c43a5677-59a1-4625-9876-c97f72dee66e', '3b6a3384-db6d-4103-b36e-76b684b3d60a'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:00:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:56 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:00:56 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:00:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:56 devstack sudo[109351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:00:56 devstack sudo[109351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:56 devstack sudo[109349]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d" returned: 0 in 0.709s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:56 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:00:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:56 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c14181-1dff-4d21-8357-ab188394449d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:56 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22fb8d8b-45b0-4697-ab12-7336c85d05e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:56 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Volume volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d (544f46a8-3587-40e9-b69e-7b7cfc25eb8d): created successfully Jun 24 10:00:56 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22fb8d8b-45b0-4697-ab12-7336c85d05e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:56 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Flow 'volume_create_manager' (d0c7fe1c-95c0-4cbb-857d-1a4a74d17f5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:00:56 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-cdddbdc2-a07e-4774-82b7-fc80ee066109 tempest-VolumesSnapshotTestJSON-1010016385 None] Created volume successfully. Jun 24 10:00:56 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Flow 'volume_create_manager' (108c9db4-dd12-4fcd-93bc-684054112df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396f29f6-f856-4c32-949c-28e23d17cfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:57 devstack sudo[109351]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.689s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:00:57 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Deleted volume successfully. Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396f29f6-f856-4c32-949c-28e23d17cfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631003ae-a526-48ac-877b-bcc795b494d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28624cf7a5384f12807fb5d87fcb4835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:00:57Z,use_quota=True,user_id='a0445c8399884c068109c842f67b7900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e78d40-8ab6-4f81-bca3-0bc657772d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e78d40-8ab6-4f81-bca3-0bc657772d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a8b1d7-5145-49b8-b99b-b53a2d7e59b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG cinder.image.glance [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Creating Keystone auth plugin from conf {{(pid=93447) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b92ba38a-b17b-4e1e-b551-ce40014a7db0 tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-ab63fd52-3899-4f16-9296-2263ba993d26-delete_volume" released by "delete_volume" :: held 6.686s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4ea155a6-f5e4-43df-9c24-b7ae25b3132d tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "cinder-07d1c6b9-a949-4c7b-a560-17d7e3430f62-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4ea155a6-f5e4-43df-9c24-b7ae25b3132d tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-07d1c6b9-a949-4c7b-a560-17d7e3430f62-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4ea155a6-f5e4-43df-9c24-b7ae25b3132d tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "cinder-quobyte-07d1c6b9-a949-4c7b-a560-17d7e3430f62" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4ea155a6-f5e4-43df-9c24-b7ae25b3132d tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-quobyte-07d1c6b9-a949-4c7b-a560-17d7e3430f62" acquired by "delete_volume" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0696d9-310e-4d4b-b618-09b299126168]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4ea155a6-f5e4-43df-9c24-b7ae25b3132d tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-07d1c6b9-a949-4c7b-a560-17d7e3430f62 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a8b1d7-5145-49b8-b99b-b53a2d7e59b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '631003ae-a526-48ac-877b-bcc795b494d6', 'volume_name': 'volume-631003ae-a526-48ac-877b-bcc795b494d6', 'volume_size': 1, 'image_id': 'c0075295-c84e-44c9-86e1-675ab65ce30e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0075295-c84e-44c9-86e1-675ab65ce30e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '52303cecd8e3b45cc7fe994e1ba6cc7b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '28624cf7a5384f12807fb5d87fcb4835', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '49181fdaf94cc1b4e415c8c734f8af3fc191cfb07553e5b4583504983d1e58c30ab7bf7c432dfc522840e5a304a23075d3dad15680893bc304e1ff6e7a47a8c5', 'id': 'c0075295-c84e-44c9-86e1-675ab65ce30e', 'created_at': datetime.datetime(2026, 6, 24, 8, 0, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 8, 0, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0075295-c84e-44c9-86e1-675ab65ce30e/file', 'properties': {}}, 'image_service': }' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9f04fa-886d-4b68-86ed-d114d7ec5f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9f04fa-886d-4b68-86ed-d114d7ec5f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4177ac-5a6a-4de2-8bfe-56b418b4e7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:00:57 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Volume 631003ae-a526-48ac-877b-bcc795b494d6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-631003ae-a526-48ac-877b-bcc795b494d6', 'volume_size': 1, 'image_id': 'c0075295-c84e-44c9-86e1-675ab65ce30e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0075295-c84e-44c9-86e1-675ab65ce30e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '52303cecd8e3b45cc7fe994e1ba6cc7b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '28624cf7a5384f12807fb5d87fcb4835', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '49181fdaf94cc1b4e415c8c734f8af3fc191cfb07553e5b4583504983d1e58c30ab7bf7c432dfc522840e5a304a23075d3dad15680893bc304e1ff6e7a47a8c5', 'id': 'c0075295-c84e-44c9-86e1-675ab65ce30e', 'created_at': datetime.datetime(2026, 6, 24, 8, 0, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 8, 0, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0075295-c84e-44c9-86e1-675ab65ce30e/file', 'properties': {}}, 'image_service': } Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Trying to clone 631003ae-a526-48ac-877b-bcc795b494d6 from image c0075295-c84e-44c9-86e1-675ab65ce30e at location (None, [{'url': 'file:///opt/stack/data/glance/images/c0075295-c84e-44c9-86e1-675ab65ce30e', 'metadata': {}}]). {{(pid=93447) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-04ea535f-f2e9-485c-8a81-017dcfd2899e tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-04ea535f-f2e9-485c-8a81-017dcfd2899e tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:57 devstack sudo[109355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-07d1c6b9-a949-4c7b-a560-17d7e3430f62 Jun 24 10:00:57 devstack sudo[109355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-04ea535f-f2e9-485c-8a81-017dcfd2899e tempest-VolumesSnapshotTestJSON-1010016385 None] Creating offline snapshot abbb8d24-e43b-45f2-863f-b33608f0fd8e of volume 544f46a8-3587-40e9-b69e-7b7cfc25eb8d {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabf29a5-611d-43c7-8a45-f270b042f235]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-04ea535f-f2e9-485c-8a81-017dcfd2899e tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 10:00:57 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Image download 0.00 MB at 0.00 MB/s Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1e5b2b-f762-4078-b906-6d61c9487ec4]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:57 devstack sudo[109357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d Jun 24 10:00:57 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:57 devstack sudo[109358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD Jun 24 10:00:57 devstack sudo[109358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:58 devstack sudo[109355]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4ea155a6-f5e4-43df-9c24-b7ae25b3132d tempest-VolumesDeleteCascade-1955756731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-07d1c6b9-a949-4c7b-a560-17d7e3430f62" returned: 0 in 0.842s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4ea155a6-f5e4-43df-9c24-b7ae25b3132d tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-07d1c6b9-a949-4c7b-a560-17d7e3430f62 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:58 devstack sudo[109366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-07d1c6b9-a949-4c7b-a560-17d7e3430f62 Jun 24 10:00:58 devstack sudo[109366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:58 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-04ea535f-f2e9-485c-8a81-017dcfd2899e tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d" returned: 0 in 0.778s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-04ea535f-f2e9-485c-8a81-017dcfd2899e tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.abbb8d24-e43b-45f2-863f-b33608f0fd8e 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:58 devstack sudo[109371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.abbb8d24-e43b-45f2-863f-b33608f0fd8e 1G Jun 24 10:00:58 devstack sudo[109371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:58 devstack sudo[109358]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD" returned: 0 in 0.754s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:58 devstack sudo[109373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD Jun 24 10:00:58 devstack sudo[109373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:58 devstack sudo[109366]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4ea155a6-f5e4-43df-9c24-b7ae25b3132d tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-07d1c6b9-a949-4c7b-a560-17d7e3430f62" returned: 0 in 0.658s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:58 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4ea155a6-f5e4-43df-9c24-b7ae25b3132d tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-quobyte-07d1c6b9-a949-4c7b-a560-17d7e3430f62" released by "delete_volume" :: held 1.549s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:00:58 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-4ea155a6-f5e4-43df-9c24-b7ae25b3132d tempest-VolumesDeleteCascade-1955756731 None] Created reservations ['35f90df3-8079-4210-8b8b-f98b980b8fa5', '16a891d7-7225-4371-928e-662615a1f664', '4c9be82f-51e5-4667-a41f-e954b9d1b7f8', 'ecdfcc4b-c8f5-4a21-bdbe-45539399757a'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:00:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4ea155a6-f5e4-43df-9c24-b7ae25b3132d tempest-VolumesDeleteCascade-1955756731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:00:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4ea155a6-f5e4-43df-9c24-b7ae25b3132d tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:00:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4ea155a6-f5e4-43df-9c24-b7ae25b3132d tempest-VolumesDeleteCascade-1955756731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:00:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4ea155a6-f5e4-43df-9c24-b7ae25b3132d tempest-VolumesDeleteCascade-1955756731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:00:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4ea155a6-f5e4-43df-9c24-b7ae25b3132d tempest-VolumesDeleteCascade-1955756731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:00:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4ea155a6-f5e4-43df-9c24-b7ae25b3132d tempest-VolumesDeleteCascade-1955756731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:59 devstack sudo[109382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:00:59 devstack sudo[109382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:59 devstack sudo[109373]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD" returned: 1 in 0.805s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:00:59 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Temporary image c0075295-c84e-44c9-86e1-675ab65ce30e is fetched for user a0445c8399884c068109c842f67b7900. {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 10:00:59 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9046fc4-e624-4a88-a4d7-46d0dcd049eb]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:00:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:59 devstack sudo[109371]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-04ea535f-f2e9-485c-8a81-017dcfd2899e tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.abbb8d24-e43b-45f2-863f-b33608f0fd8e 1G" returned: 0 in 0.970s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-04ea535f-f2e9-485c-8a81-017dcfd2899e tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.abbb8d24-e43b-45f2-863f-b33608f0fd8e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:00:59 devstack sudo[109385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.abbb8d24-e43b-45f2-863f-b33608f0fd8e Jun 24 10:00:59 devstack sudo[109385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:59 devstack sudo[109384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD Jun 24 10:00:59 devstack sudo[109384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:00:59 devstack sudo[109382]: pam_unix(sudo:session): session closed for user root Jun 24 10:00:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4ea155a6-f5e4-43df-9c24-b7ae25b3132d tempest-VolumesDeleteCascade-1955756731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.735s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:00:59 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-4ea155a6-f5e4-43df-9c24-b7ae25b3132d tempest-VolumesDeleteCascade-1955756731 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:00:59 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-4ea155a6-f5e4-43df-9c24-b7ae25b3132d tempest-VolumesDeleteCascade-1955756731 None] Deleted volume successfully. Jun 24 10:00:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4ea155a6-f5e4-43df-9c24-b7ae25b3132d tempest-VolumesDeleteCascade-1955756731 None] Lock "cinder-07d1c6b9-a949-4c7b-a560-17d7e3430f62-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:00 devstack sudo[109385]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-04ea535f-f2e9-485c-8a81-017dcfd2899e tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.abbb8d24-e43b-45f2-863f-b33608f0fd8e" returned: 0 in 0.787s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:00 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-04ea535f-f2e9-485c-8a81-017dcfd2899e tempest-VolumesSnapshotTestJSON-1010016385 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.abbb8d24-e43b-45f2-863f-b33608f0fd8e is being set with open permissions: ugo+rw Jun 24 10:01:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-04ea535f-f2e9-485c-8a81-017dcfd2899e tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.abbb8d24-e43b-45f2-863f-b33608f0fd8e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:00 devstack sudo[109394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.abbb8d24-e43b-45f2-863f-b33608f0fd8e Jun 24 10:01:00 devstack sudo[109394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:00 devstack sudo[109384]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD" returned: 0 in 0.877s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:00 devstack sudo[109396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD Jun 24 10:01:00 devstack sudo[109396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:00 devstack sudo[109394]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-04ea535f-f2e9-485c-8a81-017dcfd2899e tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.abbb8d24-e43b-45f2-863f-b33608f0fd8e" returned: 0 in 0.692s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-04ea535f-f2e9-485c-8a81-017dcfd2899e tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:00 devstack sudo[109399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.info Jun 24 10:01:00 devstack sudo[109399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:00 devstack sudo[109396]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD" returned: 1 in 0.825s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:01:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:01 devstack sudo[109399]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-04ea535f-f2e9-485c-8a81-017dcfd2899e tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.info" returned: 0 in 0.678s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:01 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-04ea535f-f2e9-485c-8a81-017dcfd2899e tempest-VolumesSnapshotTestJSON-1010016385 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.info is being set with open permissions: ugo+rw Jun 24 10:01:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-04ea535f-f2e9-485c-8a81-017dcfd2899e tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:01 devstack sudo[109406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.info Jun 24 10:01:01 devstack sudo[109406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:02 devstack sudo[109406]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-04ea535f-f2e9-485c-8a81-017dcfd2899e tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.info" returned: 0 in 0.661s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-04ea535f-f2e9-485c-8a81-017dcfd2899e tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.699s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.214s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631003ae-a526-48ac-877b-bcc795b494d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28624cf7a5384f12807fb5d87fcb4835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:00:57Z,use_quota=True,user_id='a0445c8399884c068109c842f67b7900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Creating volume 631003ae-a526-48ac-877b-bcc795b494d6 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:01:02 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:02 devstack sudo[109410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6 1073741824 Jun 24 10:01:02 devstack sudo[109410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:02 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-04ea535f-f2e9-485c-8a81-017dcfd2899e tempest-VolumesSnapshotTestJSON-1010016385 None] Create snapshot completed successfully Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Flow 'volume_create_manager' (cef5ced8-35e6-4e68-abd7-d6288dc34955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7cabd31-934e-4aa2-900d-a6bd5cd21793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7cabd31-934e-4aa2-900d-a6bd5cd21793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-491855506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1364ad5f-25aa-413a-849c-f08a00b5a803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab7c15563e64ee7974d4c9688a4fdff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:01:02Z,use_quota=True,user_id='c05cd99e88334c49af8969da69b0c20c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b150a6d4-666c-4e78-9c99-c18e39d5aad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b150a6d4-666c-4e78-9c99-c18e39d5aad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c78514a-7f80-4581-83da-e54c9a862ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c78514a-7f80-4581-83da-e54c9a862ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1364ad5f-25aa-413a-849c-f08a00b5a803', 'volume_name': 'volume-1364ad5f-25aa-413a-849c-f08a00b5a803', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81bb8b25-db63-492a-a7ef-de805971f187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81bb8b25-db63-492a-a7ef-de805971f187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5f430b-8c32-427c-b7c2-474137faf458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:02 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Volume 1364ad5f-25aa-413a-849c-f08a00b5a803: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1364ad5f-25aa-413a-849c-f08a00b5a803', 'volume_size': 1} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7a2b9575-6f9a-4b3a-8934-41ad8d370962 tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "cinder-abbb8d24-e43b-45f2-863f-b33608f0fd8e-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7a2b9575-6f9a-4b3a-8934-41ad8d370962 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-abbb8d24-e43b-45f2-863f-b33608f0fd8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7a2b9575-6f9a-4b3a-8934-41ad8d370962 tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "cinder-quobyte-544f46a8-3587-40e9-b69e-7b7cfc25eb8d" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7a2b9575-6f9a-4b3a-8934-41ad8d370962 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-544f46a8-3587-40e9-b69e-7b7cfc25eb8d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7a2b9575-6f9a-4b3a-8934-41ad8d370962 tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "cinder-quobyte-abbb8d24-e43b-45f2-863f-b33608f0fd8e" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7a2b9575-6f9a-4b3a-8934-41ad8d370962 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-abbb8d24-e43b-45f2-863f-b33608f0fd8e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-7a2b9575-6f9a-4b3a-8934-41ad8d370962 tempest-VolumesSnapshotTestJSON-1010016385 None] Deleting offline snapshot abbb8d24-e43b-45f2-863f-b33608f0fd8e of volume 544f46a8-3587-40e9-b69e-7b7cfc25eb8d {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-7a2b9575-6f9a-4b3a-8934-41ad8d370962 tempest-VolumesSnapshotTestJSON-1010016385 None] snapshot_file for this snap is: volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.abbb8d24-e43b-45f2-863f-b33608f0fd8e {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4120ab8-f37b-4af0-a2e4-186e88c5b14b]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7a2b9575-6f9a-4b3a-8934-41ad8d370962 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.abbb8d24-e43b-45f2-863f-b33608f0fd8e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:03 devstack sudo[109422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.abbb8d24-e43b-45f2-863f-b33608f0fd8e Jun 24 10:01:03 devstack sudo[109422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:03 devstack sudo[109410]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6 1073741824" returned: 0 in 0.908s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:03 devstack sudo[109424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6 Jun 24 10:01:03 devstack sudo[109424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:03 devstack sudo[109422]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7a2b9575-6f9a-4b3a-8934-41ad8d370962 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.abbb8d24-e43b-45f2-863f-b33608f0fd8e" returned: 0 in 0.766s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:03 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-7a2b9575-6f9a-4b3a-8934-41ad8d370962 tempest-VolumesSnapshotTestJSON-1010016385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:01:03 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ed05cd-456f-498b-bfa7-66c1147c7396]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7a2b9575-6f9a-4b3a-8934-41ad8d370962 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:03 devstack sudo[109424]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6" returned: 0 in 0.677s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:03 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:01:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.233s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:03 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-491855506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1364ad5f-25aa-413a-849c-f08a00b5a803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dab7c15563e64ee7974d4c9688a4fdff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:01:02Z,use_quota=True,user_id='c05cd99e88334c49af8969da69b0c20c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:01:03 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Creating volume 1364ad5f-25aa-413a-849c-f08a00b5a803 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:01:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:03 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:01:03 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:01:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:03 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:01:03 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:01:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:03 devstack sudo[109430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d Jun 24 10:01:03 devstack sudo[109430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:03 devstack sudo[109432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803 1073741824 Jun 24 10:01:03 devstack sudo[109432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:03 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Attempting download of c0075295-c84e-44c9-86e1-675ab65ce30e ((None, [{'url': 'file:///opt/stack/data/glance/images/c0075295-c84e-44c9-86e1-675ab65ce30e', 'metadata': {}}])) to volume 631003ae-a526-48ac-877b-bcc795b494d6. {{(pid=93447) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 10:01:03 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3f2359-e74b-45e5-8b78-2c8d60ea2c35]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0075295-c84e-44c9-86e1-675ab65ce30e_dcv3d903 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:04 devstack sudo[109434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0075295-c84e-44c9-86e1-675ab65ce30e_dcv3d903 Jun 24 10:01:04 devstack sudo[109434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:04 devstack sudo[109430]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7a2b9575-6f9a-4b3a-8934-41ad8d370962 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d" returned: 0 in 0.774s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7a2b9575-6f9a-4b3a-8934-41ad8d370962 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.abbb8d24-e43b-45f2-863f-b33608f0fd8e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:04 devstack sudo[109442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.abbb8d24-e43b-45f2-863f-b33608f0fd8e Jun 24 10:01:04 devstack sudo[109442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:04 devstack sudo[109432]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803 1073741824" returned: 0 in 0.855s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:04 devstack sudo[109434]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c0075295-c84e-44c9-86e1-675ab65ce30e_dcv3d903" returned: 0 in 0.759s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0075295-c84e-44c9-86e1-675ab65ce30e_dcv3d903 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:04 devstack sudo[109447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803 Jun 24 10:01:04 devstack sudo[109447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:04 devstack sudo[109446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0075295-c84e-44c9-86e1-675ab65ce30e_dcv3d903 Jun 24 10:01:04 devstack sudo[109446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:05 devstack sudo[109442]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7a2b9575-6f9a-4b3a-8934-41ad8d370962 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.abbb8d24-e43b-45f2-863f-b33608f0fd8e" returned: 0 in 0.727s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7a2b9575-6f9a-4b3a-8934-41ad8d370962 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.abbb8d24-e43b-45f2-863f-b33608f0fd8e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:05 devstack sudo[109453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.abbb8d24-e43b-45f2-863f-b33608f0fd8e Jun 24 10:01:05 devstack sudo[109453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:05 devstack sudo[109447]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803" returned: 0 in 0.651s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:05 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:01:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:05 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d5f430b-8c32-427c-b7c2-474137faf458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1364ad5f-25aa-413a-849c-f08a00b5a803', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:05 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfe97ec5-56c7-4146-abbd-72274de2fae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:05 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Volume volume-1364ad5f-25aa-413a-849c-f08a00b5a803 (1364ad5f-25aa-413a-849c-f08a00b5a803): created successfully Jun 24 10:01:05 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfe97ec5-56c7-4146-abbd-72274de2fae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:05 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Flow 'volume_create_manager' (cef5ced8-35e6-4e68-abd7-d6288dc34955) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:01:05 devstack sudo[109446]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0075295-c84e-44c9-86e1-675ab65ce30e_dcv3d903" returned: 1 in 0.750s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c0075295-c84e-44c9-86e1-675ab65ce30e_dcv3d903' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:01:05 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-558cc5d4-d461-46d5-8201-578b1eef30fa tempest-VolumesSnapshotListTestJSON-1490763852 None] Created volume successfully. Jun 24 10:01:05 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6010a423-10e6-4637-bcaf-23ac2b01cafe]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:05 devstack sudo[109458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD Jun 24 10:01:05 devstack sudo[109458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6e2947be-6188-4321-afdb-931654d67e47 tempest-VolumesSnapshotListTestJSON-1490763852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6e2947be-6188-4321-afdb-931654d67e47 tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:05 devstack sudo[109453]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:05 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-6e2947be-6188-4321-afdb-931654d67e47 tempest-VolumesSnapshotListTestJSON-1490763852 None] Creating offline snapshot b5dba170-0049-4c77-bc41-c5680e0e9785 of volume 1364ad5f-25aa-413a-849c-f08a00b5a803 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 10:01:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7a2b9575-6f9a-4b3a-8934-41ad8d370962 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d.abbb8d24-e43b-45f2-863f-b33608f0fd8e" returned: 0 in 0.673s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:05 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2df244-fe40-4b67-b034-8844057066ec]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6e2947be-6188-4321-afdb-931654d67e47 tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7a2b9575-6f9a-4b3a-8934-41ad8d370962 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-abbb8d24-e43b-45f2-863f-b33608f0fd8e" released by "_delete_snapshot" :: held 3.062s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:06 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7a2b9575-6f9a-4b3a-8934-41ad8d370962 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-544f46a8-3587-40e9-b69e-7b7cfc25eb8d" released by "delete_snapshot" :: held 3.085s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:06 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-7a2b9575-6f9a-4b3a-8934-41ad8d370962 tempest-VolumesSnapshotTestJSON-1010016385 None] Created reservations ['27b4f32f-a635-4ff0-b7ba-b77002281aac', 'bec683ea-2407-4dd4-bb24-9d5a6032613b', '596c6184-0fa6-4697-96d3-bd538b549c75', '3a2bc466-ebde-44ae-99e5-b5cb25fbcb63'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:01:06 devstack sudo[109461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803 Jun 24 10:01:06 devstack sudo[109461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:06 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-7a2b9575-6f9a-4b3a-8934-41ad8d370962 tempest-VolumesSnapshotTestJSON-1010016385 None] Delete snapshot completed successfully. Jun 24 10:01:06 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7a2b9575-6f9a-4b3a-8934-41ad8d370962 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-abbb8d24-e43b-45f2-863f-b33608f0fd8e-delete_snapshot" released by "delete_snapshot" :: held 3.266s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:06 devstack sudo[109458]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD" returned: 0 in 0.789s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:06 devstack sudo[109465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD Jun 24 10:01:06 devstack sudo[109465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:06 devstack sudo[109461]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6e2947be-6188-4321-afdb-931654d67e47 tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803" returned: 0 in 0.769s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6e2947be-6188-4321-afdb-931654d67e47 tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:06 devstack sudo[109470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785 1G Jun 24 10:01:06 devstack sudo[109470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:07 devstack sudo[109465]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD" returned: 1 in 0.753s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:01:07 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] c0075295-c84e-44c9-86e1-675ab65ce30e was raw, converting to raw {{(pid=93447) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 10:01:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:07 devstack sudo[109475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6 Jun 24 10:01:07 devstack sudo[109475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:07 devstack sudo[109470]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6e2947be-6188-4321-afdb-931654d67e47 tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785 1G" returned: 0 in 0.885s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6e2947be-6188-4321-afdb-931654d67e47 tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1364ad5f-25aa-413a-849c-f08a00b5a803 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:07 devstack sudo[109482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1364ad5f-25aa-413a-849c-f08a00b5a803 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785 Jun 24 10:01:07 devstack sudo[109482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:07 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:01:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Flow 'volume_create_manager' (ac8e57ac-b8a8-46e2-a4f1-816a7a2f385d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:01:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a04b97b-53a4-4845-9537-6a93d3398f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a04b97b-53a4-4845-9537-6a93d3398f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1643104849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a18a71c-558c-4a07-a593-ab6cf16a3385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89229ce502b54ba6b5d7e77368f48d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:01:08Z,use_quota=True,user_id='cd3616fb82f34fc7aee1a2da76b3d4f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4d5635-f7ab-483f-8127-a54f176bc4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4d5635-f7ab-483f-8127-a54f176bc4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3438deef-ca45-4641-9e0f-acbf919af676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3438deef-ca45-4641-9e0f-acbf919af676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a18a71c-558c-4a07-a593-ab6cf16a3385', 'volume_name': 'volume-5a18a71c-558c-4a07-a593-ab6cf16a3385', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098c5e3e-32e9-4d6d-b509-63a94d5e72d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098c5e3e-32e9-4d6d-b509-63a94d5e72d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:07 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b802fa-cc35-4755-8d42-6cdc0d10ca70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:07 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Volume 5a18a71c-558c-4a07-a593-ab6cf16a3385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a18a71c-558c-4a07-a593-ab6cf16a3385', 'volume_size': 1} Jun 24 10:01:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:07 devstack sudo[109475]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6" returned: 0 in 0.809s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:07 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c0075295-c84e-44c9-86e1-675ab65ce30e_fb3cldd0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6 {{(pid=93447) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 10:01:07 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Converted 0.00 MB image at 0.00 MB/s Jun 24 10:01:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:07 devstack sudo[109485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6 1G Jun 24 10:01:07 devstack sudo[109485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:08 devstack sudo[109482]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6e2947be-6188-4321-afdb-931654d67e47 tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1364ad5f-25aa-413a-849c-f08a00b5a803 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785" returned: 0 in 0.700s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:08 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-6e2947be-6188-4321-afdb-931654d67e47 tempest-VolumesSnapshotListTestJSON-1490763852 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785 is being set with open permissions: ugo+rw Jun 24 10:01:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6e2947be-6188-4321-afdb-931654d67e47 tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:08 devstack sudo[109490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785 Jun 24 10:01:08 devstack sudo[109490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:08 devstack sudo[109485]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6 1G" returned: 0 in 0.704s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:08 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb22c2c4-a39f-4550-9614-7ab83aceb0a5]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:08 devstack sudo[109495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6 Jun 24 10:01:08 devstack sudo[109495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:08 devstack sudo[109490]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6e2947be-6188-4321-afdb-931654d67e47 tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785" returned: 0 in 0.661s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6e2947be-6188-4321-afdb-931654d67e47 tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:09 devstack sudo[109498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.info Jun 24 10:01:09 devstack sudo[109498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:09 devstack sudo[109495]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6" returned: 0 in 0.750s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:09 devstack sudo[109502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6 Jun 24 10:01:09 devstack sudo[109502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:09 devstack sudo[109498]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6e2947be-6188-4321-afdb-931654d67e47 tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.info" returned: 0 in 0.667s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:09 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-6e2947be-6188-4321-afdb-931654d67e47 tempest-VolumesSnapshotListTestJSON-1490763852 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.info is being set with open permissions: ugo+rw Jun 24 10:01:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6e2947be-6188-4321-afdb-931654d67e47 tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:09 devstack sudo[109505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.info Jun 24 10:01:09 devstack sudo[109505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:10 devstack sudo[109502]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6" returned: 1 in 0.807s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Downloaded image c0075295-c84e-44c9-86e1-675ab65ce30e ((None, [{'url': 'file:///opt/stack/data/glance/images/c0075295-c84e-44c9-86e1-675ab65ce30e', 'metadata': {}}])) to volume 631003ae-a526-48ac-877b-bcc795b494d6 successfully. {{(pid=93447) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Temporary image c0075295-c84e-44c9-86e1-675ab65ce30e for user a0445c8399884c068109c842f67b7900 is deleted. {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Marking volume 631003ae-a526-48ac-877b-bcc795b494d6 as bootable. {{(pid=93447) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Copying metadata from image c0075295-c84e-44c9-86e1-675ab65ce30e to 631003ae-a526-48ac-877b-bcc795b494d6. {{(pid=93447) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Creating volume glance metadata for volume 631003ae-a526-48ac-877b-bcc795b494d6 backed by image c0075295-c84e-44c9-86e1-675ab65ce30e with: {'image_id': 'c0075295-c84e-44c9-86e1-675ab65ce30e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '52303cecd8e3b45cc7fe994e1ba6cc7b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93447) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4177ac-5a6a-4de2-8bfe-56b418b4e7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-631003ae-a526-48ac-877b-bcc795b494d6', 'volume_size': 1, 'image_id': 'c0075295-c84e-44c9-86e1-675ab65ce30e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c0075295-c84e-44c9-86e1-675ab65ce30e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '52303cecd8e3b45cc7fe994e1ba6cc7b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '28624cf7a5384f12807fb5d87fcb4835', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '49181fdaf94cc1b4e415c8c734f8af3fc191cfb07553e5b4583504983d1e58c30ab7bf7c432dfc522840e5a304a23075d3dad15680893bc304e1ff6e7a47a8c5', 'id': 'c0075295-c84e-44c9-86e1-675ab65ce30e', 'created_at': datetime.datetime(2026, 6, 24, 8, 0, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 8, 0, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c0075295-c84e-44c9-86e1-675ab65ce30e/file', 'properties': {}}, 'image_service': }' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2f90d1-1ee8-4dc6-87f3-0bfb1fc28ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:10 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Volume volume-631003ae-a526-48ac-877b-bcc795b494d6 (631003ae-a526-48ac-877b-bcc795b494d6): created successfully Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2f90d1-1ee8-4dc6-87f3-0bfb1fc28ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Flow 'volume_create_manager' (108c9db4-dd12-4fcd-93bc-684054112df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:01:10 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-8aeb0598-ff9a-42b3-9af4-c1da168a45f7 tempest-VolumeImageDependencyTests-1994371095 None] Created volume successfully. Jun 24 10:01:10 devstack sudo[109505]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6e2947be-6188-4321-afdb-931654d67e47 tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.info" returned: 0 in 0.680s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6e2947be-6188-4321-afdb-931654d67e47 tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.469s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.606s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1643104849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a18a71c-558c-4a07-a593-ab6cf16a3385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89229ce502b54ba6b5d7e77368f48d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:01:08Z,use_quota=True,user_id='cd3616fb82f34fc7aee1a2da76b3d4f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Creating volume 5a18a71c-558c-4a07-a593-ab6cf16a3385 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:01:10 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:10 devstack sudo[109511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 1073741824 Jun 24 10:01:10 devstack sudo[109511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:10 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-6e2947be-6188-4321-afdb-931654d67e47 tempest-VolumesSnapshotListTestJSON-1490763852 None] Create snapshot completed successfully Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-220884f5-5887-4a7a-8b61-52c410a8e6db tempest-VolumeImageDependencyTests-1994371095 None] Acquiring lock "cinder-631003ae-a526-48ac-877b-bcc795b494d6-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-220884f5-5887-4a7a-8b61-52c410a8e6db tempest-VolumeImageDependencyTests-1994371095 None] Lock "cinder-631003ae-a526-48ac-877b-bcc795b494d6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-220884f5-5887-4a7a-8b61-52c410a8e6db tempest-VolumeImageDependencyTests-1994371095 None] Acquiring lock "cinder-quobyte-631003ae-a526-48ac-877b-bcc795b494d6" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-220884f5-5887-4a7a-8b61-52c410a8e6db tempest-VolumeImageDependencyTests-1994371095 None] Lock "cinder-quobyte-631003ae-a526-48ac-877b-bcc795b494d6" acquired by "delete_volume" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6e8edb-da37-4710-8d75-b31cb09ada06]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-220884f5-5887-4a7a-8b61-52c410a8e6db tempest-VolumeImageDependencyTests-1994371095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:11 devstack sudo[109516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6 Jun 24 10:01:11 devstack sudo[109516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:11 devstack sudo[109511]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-99cce50b-c8ee-46d4-91d4-09e959fdc4dc tempest-VolumesSnapshotListTestJSON-1490763852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 1073741824" returned: 0 in 0.908s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:11 devstack sudo[109519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 Jun 24 10:01:11 devstack sudo[109519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:11 devstack sudo[109516]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-220884f5-5887-4a7a-8b61-52c410a8e6db tempest-VolumeImageDependencyTests-1994371095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6" returned: 0 in 0.817s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-220884f5-5887-4a7a-8b61-52c410a8e6db tempest-VolumeImageDependencyTests-1994371095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:11 devstack sudo[109524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6 Jun 24 10:01:11 devstack sudo[109524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:12 devstack sudo[109519]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385" returned: 0 in 0.682s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:01:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-99cce50b-c8ee-46d4-91d4-09e959fdc4dc tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.722s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b802fa-cc35-4755-8d42-6cdc0d10ca70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a18a71c-558c-4a07-a593-ab6cf16a3385', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d826c8c-1712-4d98-8933-439399a9eb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-99cce50b-c8ee-46d4-91d4-09e959fdc4dc tempest-VolumesSnapshotListTestJSON-1490763852 None] Creating offline snapshot e6f1f96b-7d56-4f08-b150-2e23ee721c18 of volume 1364ad5f-25aa-413a-849c-f08a00b5a803 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 10:01:12 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d93b31-68eb-40e8-b8c8-d2b3f204b100]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-99cce50b-c8ee-46d4-91d4-09e959fdc4dc tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:12 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Volume volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 (5a18a71c-558c-4a07-a593-ab6cf16a3385): created successfully Jun 24 10:01:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d826c8c-1712-4d98-8933-439399a9eb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Flow 'volume_create_manager' (ac8e57ac-b8a8-46e2-a4f1-816a7a2f385d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:01:12 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-3009ded2-05be-4045-8d97-1e93bf996844 tempest-VolumesSnapshotTestJSON-1010016385 None] Created volume successfully. Jun 24 10:01:12 devstack sudo[109527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785 Jun 24 10:01:12 devstack sudo[109527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:12 devstack sudo[109524]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-220884f5-5887-4a7a-8b61-52c410a8e6db tempest-VolumeImageDependencyTests-1994371095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6" returned: 1 in 0.817s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-220884f5-5887-4a7a-8b61-52c410a8e6db tempest-VolumeImageDependencyTests-1994371095 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:01:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-220884f5-5887-4a7a-8b61-52c410a8e6db tempest-VolumeImageDependencyTests-1994371095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:12 devstack sudo[109532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6 Jun 24 10:01:12 devstack sudo[109532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:12 devstack sudo[109527]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-99cce50b-c8ee-46d4-91d4-09e959fdc4dc tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785" returned: 0 in 0.824s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-99cce50b-c8ee-46d4-91d4-09e959fdc4dc tempest-VolumesSnapshotListTestJSON-1490763852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1364ad5f-25aa-413a-849c-f08a00b5a803(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:01:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-99cce50b-c8ee-46d4-91d4-09e959fdc4dc tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:12 devstack sudo[109537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18 1G Jun 24 10:01:12 devstack sudo[109537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-28bbccb4-df33-4c93-bffa-c4a64974ec45 tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:13 devstack sudo[109532]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-220884f5-5887-4a7a-8b61-52c410a8e6db tempest-VolumeImageDependencyTests-1994371095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-631003ae-a526-48ac-877b-bcc795b494d6" returned: 0 in 0.682s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:13 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-220884f5-5887-4a7a-8b61-52c410a8e6db tempest-VolumeImageDependencyTests-1994371095 None] Lock "cinder-quobyte-631003ae-a526-48ac-877b-bcc795b494d6" released by "delete_volume" :: held 2.379s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:13 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-220884f5-5887-4a7a-8b61-52c410a8e6db tempest-VolumeImageDependencyTests-1994371095 None] Created reservations ['dfbfcc17-04b9-40d7-95cd-05d670d6ed5a', '387e3aac-de2e-4b98-aff6-1fbbc462bedb', 'bdce29b2-c657-4195-b507-ba4a3b7b441c', '64f6e08a-406b-4112-99b2-9d87f5705473'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:01:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-220884f5-5887-4a7a-8b61-52c410a8e6db tempest-VolumeImageDependencyTests-1994371095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-220884f5-5887-4a7a-8b61-52c410a8e6db tempest-VolumeImageDependencyTests-1994371095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-220884f5-5887-4a7a-8b61-52c410a8e6db tempest-VolumeImageDependencyTests-1994371095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:01:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-220884f5-5887-4a7a-8b61-52c410a8e6db tempest-VolumeImageDependencyTests-1994371095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:01:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-220884f5-5887-4a7a-8b61-52c410a8e6db tempest-VolumeImageDependencyTests-1994371095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-220884f5-5887-4a7a-8b61-52c410a8e6db tempest-VolumeImageDependencyTests-1994371095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:13 devstack sudo[109540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:01:13 devstack sudo[109540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:13 devstack sudo[109537]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-99cce50b-c8ee-46d4-91d4-09e959fdc4dc tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18 1G" returned: 0 in 0.866s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-99cce50b-c8ee-46d4-91d4-09e959fdc4dc tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:13 devstack sudo[109545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18 Jun 24 10:01:13 devstack sudo[109545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:14 devstack sudo[109540]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-220884f5-5887-4a7a-8b61-52c410a8e6db tempest-VolumeImageDependencyTests-1994371095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.678s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:14 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-220884f5-5887-4a7a-8b61-52c410a8e6db tempest-VolumeImageDependencyTests-1994371095 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:01:14 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-220884f5-5887-4a7a-8b61-52c410a8e6db tempest-VolumeImageDependencyTests-1994371095 None] Deleted volume successfully. Jun 24 10:01:14 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-220884f5-5887-4a7a-8b61-52c410a8e6db tempest-VolumeImageDependencyTests-1994371095 None] Lock "cinder-631003ae-a526-48ac-877b-bcc795b494d6-delete_volume" released by "delete_volume" :: held 3.276s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:14 devstack sudo[109545]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-99cce50b-c8ee-46d4-91d4-09e959fdc4dc tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18" returned: 0 in 0.764s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:14 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-99cce50b-c8ee-46d4-91d4-09e959fdc4dc tempest-VolumesSnapshotListTestJSON-1490763852 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18 is being set with open permissions: ugo+rw Jun 24 10:01:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-99cce50b-c8ee-46d4-91d4-09e959fdc4dc tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:14 devstack sudo[109551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18 Jun 24 10:01:14 devstack sudo[109551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:15 devstack sudo[109551]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-99cce50b-c8ee-46d4-91d4-09e959fdc4dc tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18" returned: 0 in 0.662s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-99cce50b-c8ee-46d4-91d4-09e959fdc4dc tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.252s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-28bbccb4-df33-4c93-bffa-c4a64974ec45 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.089s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:15 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-28bbccb4-df33-4c93-bffa-c4a64974ec45 tempest-VolumesSnapshotTestJSON-1010016385 None] Creating offline snapshot 271f4e4c-38af-432f-926d-d2b1c022458a of volume 5a18a71c-558c-4a07-a593-ab6cf16a3385 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 10:01:15 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-99cce50b-c8ee-46d4-91d4-09e959fdc4dc tempest-VolumesSnapshotListTestJSON-1490763852 None] Create snapshot completed successfully Jun 24 10:01:15 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43d62a4-5bff-4b61-a9c6-1dcf41e4e6de]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-28bbccb4-df33-4c93-bffa-c4a64974ec45 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:15 devstack sudo[109554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 Jun 24 10:01:15 devstack sudo[109554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3b96a53d-603f-4a12-aa91-cd00b4385e99 tempest-VolumesSnapshotListTestJSON-1490763852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:16 devstack sudo[109554]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-28bbccb4-df33-4c93-bffa-c4a64974ec45 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385" returned: 0 in 0.871s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-28bbccb4-df33-4c93-bffa-c4a64974ec45 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.271f4e4c-38af-432f-926d-d2b1c022458a 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:16 devstack sudo[109559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.271f4e4c-38af-432f-926d-d2b1c022458a 1G Jun 24 10:01:16 devstack sudo[109559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:17 devstack sudo[109559]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-28bbccb4-df33-4c93-bffa-c4a64974ec45 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.271f4e4c-38af-432f-926d-d2b1c022458a 1G" returned: 0 in 0.816s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-28bbccb4-df33-4c93-bffa-c4a64974ec45 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.271f4e4c-38af-432f-926d-d2b1c022458a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:17 devstack sudo[109564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.271f4e4c-38af-432f-926d-d2b1c022458a Jun 24 10:01:17 devstack sudo[109564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:17 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:01:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Flow 'volume_create_manager' (fd13bb5a-0261-4d6f-83e2-d14461b7fafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:01:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5ecbbc-15d5-4e8a-b780-f513512848dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5ecbbc-15d5-4e8a-b780-f513512848dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d6eeb7-019b-4ace-a47f-5cdff7cd9957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081b903017ed453da03fdcff321ae233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:01:17Z,use_quota=True,user_id='06772499180f4d0aafc043bdc12f62ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11f7d5f-f621-4f2c-9cd7-5c0575e47146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e11f7d5f-f621-4f2c-9cd7-5c0575e47146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac766dd-8b6a-4b97-bf04-2ed36cbaaf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac766dd-8b6a-4b97-bf04-2ed36cbaaf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87d6eeb7-019b-4ace-a47f-5cdff7cd9957', 'volume_name': 'volume-87d6eeb7-019b-4ace-a47f-5cdff7cd9957', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46468a33-1a8f-414f-81b3-4273f94c4974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46468a33-1a8f-414f-81b3-4273f94c4974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f740c6-3423-48d2-86e7-7225edce4071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:17 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Volume 87d6eeb7-019b-4ace-a47f-5cdff7cd9957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87d6eeb7-019b-4ace-a47f-5cdff7cd9957', 'volume_size': 1} Jun 24 10:01:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:17 devstack sudo[109564]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-28bbccb4-df33-4c93-bffa-c4a64974ec45 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.271f4e4c-38af-432f-926d-d2b1c022458a" returned: 0 in 0.688s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:17 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-28bbccb4-df33-4c93-bffa-c4a64974ec45 tempest-VolumesSnapshotTestJSON-1010016385 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.271f4e4c-38af-432f-926d-d2b1c022458a is being set with open permissions: ugo+rw Jun 24 10:01:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-28bbccb4-df33-4c93-bffa-c4a64974ec45 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.271f4e4c-38af-432f-926d-d2b1c022458a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:17 devstack sudo[109569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.271f4e4c-38af-432f-926d-d2b1c022458a Jun 24 10:01:17 devstack sudo[109569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:18 devstack sudo[109569]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-28bbccb4-df33-4c93-bffa-c4a64974ec45 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.271f4e4c-38af-432f-926d-d2b1c022458a" returned: 0 in 0.644s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:18 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=142,cinder:UPDATE=149,cinder:INSERT=39,cinder:DELETE=17 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 10:01:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-28bbccb4-df33-4c93-bffa-c4a64974ec45 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:18 devstack sudo[109572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.info Jun 24 10:01:18 devstack sudo[109572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:19 devstack sudo[109572]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-28bbccb4-df33-4c93-bffa-c4a64974ec45 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.info" returned: 0 in 0.633s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:19 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-28bbccb4-df33-4c93-bffa-c4a64974ec45 tempest-VolumesSnapshotTestJSON-1010016385 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.info is being set with open permissions: ugo+rw Jun 24 10:01:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-28bbccb4-df33-4c93-bffa-c4a64974ec45 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:19 devstack sudo[109575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.info Jun 24 10:01:19 devstack sudo[109575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:19 devstack sudo[109575]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-28bbccb4-df33-4c93-bffa-c4a64974ec45 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.info" returned: 0 in 0.632s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-28bbccb4-df33-4c93-bffa-c4a64974ec45 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.379s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3b96a53d-603f-4a12-aa91-cd00b4385e99 tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.957s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:19 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=129,cinder:UPDATE=171,cinder:INSERT=49,cinder:DELETE=10 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 10:01:19 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-3b96a53d-603f-4a12-aa91-cd00b4385e99 tempest-VolumesSnapshotListTestJSON-1490763852 None] Creating offline snapshot cdbf6d71-66a7-4769-ab27-2b305cd8932c of volume 1364ad5f-25aa-413a-849c-f08a00b5a803 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 10:01:19 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-28bbccb4-df33-4c93-bffa-c4a64974ec45 tempest-VolumesSnapshotTestJSON-1010016385 None] Create snapshot completed successfully Jun 24 10:01:19 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfb270c-d335-4ca8-b224-f781b71a896b]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3b96a53d-603f-4a12-aa91-cd00b4385e99 tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:19 devstack sudo[109578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18 Jun 24 10:01:19 devstack sudo[109578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:20 devstack sudo[109578]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3b96a53d-603f-4a12-aa91-cd00b4385e99 tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18" returned: 0 in 0.761s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:20 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-3b96a53d-603f-4a12-aa91-cd00b4385e99 tempest-VolumesSnapshotListTestJSON-1490763852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1364ad5f-25aa-413a-849c-f08a00b5a803(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:01:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3b96a53d-603f-4a12-aa91-cd00b4385e99 tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.cdbf6d71-66a7-4769-ab27-2b305cd8932c 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:20 devstack sudo[109583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.cdbf6d71-66a7-4769-ab27-2b305cd8932c 1G Jun 24 10:01:20 devstack sudo[109583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:21 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:01:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Flow 'volume_create_manager' (0cadbfd6-b08e-46dd-bf8d-7e86e83c27d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:01:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff5d392-a7ef-4698-966b-98cca203c1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff5d392-a7ef-4698-966b-98cca203c1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1554627485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade69b63-c0b4-4b5c-88c9-5a01cf16c180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89229ce502b54ba6b5d7e77368f48d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:01:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=271f4e4c-38af-432f-926d-d2b1c022458a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:01:21Z,use_quota=True,user_id='cd3616fb82f34fc7aee1a2da76b3d4f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025363ce-dd15-4d06-9b9d-37b1702d900f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025363ce-dd15-4d06-9b9d-37b1702d900f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (990843cd-6072-4554-8433-2febe08e5dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (990843cd-6072-4554-8433-2febe08e5dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ade69b63-c0b4-4b5c-88c9-5a01cf16c180', 'volume_name': 'volume-ade69b63-c0b4-4b5c-88c9-5a01cf16c180', 'volume_size': 2, 'snapshot_id': '271f4e4c-38af-432f-926d-d2b1c022458a'}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb60645-a810-46cc-a740-2b70993f008b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb60645-a810-46cc-a740-2b70993f008b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:21 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2783681c-1057-4aaf-a7ba-76371f841b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:21 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Volume ade69b63-c0b4-4b5c-88c9-5a01cf16c180: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ade69b63-c0b4-4b5c-88c9-5a01cf16c180', 'volume_size': 2, 'snapshot_id': '271f4e4c-38af-432f-926d-d2b1c022458a'} Jun 24 10:01:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:21 devstack sudo[109583]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3b96a53d-603f-4a12-aa91-cd00b4385e99 tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.cdbf6d71-66a7-4769-ab27-2b305cd8932c 1G" returned: 0 in 0.878s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3b96a53d-603f-4a12-aa91-cd00b4385e99 tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.cdbf6d71-66a7-4769-ab27-2b305cd8932c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:21 devstack sudo[109589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.cdbf6d71-66a7-4769-ab27-2b305cd8932c Jun 24 10:01:21 devstack sudo[109589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:22 devstack sudo[109589]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3b96a53d-603f-4a12-aa91-cd00b4385e99 tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.cdbf6d71-66a7-4769-ab27-2b305cd8932c" returned: 0 in 0.727s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:22 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-3b96a53d-603f-4a12-aa91-cd00b4385e99 tempest-VolumesSnapshotListTestJSON-1490763852 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.cdbf6d71-66a7-4769-ab27-2b305cd8932c is being set with open permissions: ugo+rw Jun 24 10:01:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3b96a53d-603f-4a12-aa91-cd00b4385e99 tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.cdbf6d71-66a7-4769-ab27-2b305cd8932c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:22 devstack sudo[109595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.cdbf6d71-66a7-4769-ab27-2b305cd8932c Jun 24 10:01:22 devstack sudo[109595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:22 devstack sudo[109595]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3b96a53d-603f-4a12-aa91-cd00b4385e99 tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.cdbf6d71-66a7-4769-ab27-2b305cd8932c" returned: 0 in 0.635s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3b96a53d-603f-4a12-aa91-cd00b4385e99 tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.100s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.338s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:22 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d6eeb7-019b-4ace-a47f-5cdff7cd9957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081b903017ed453da03fdcff321ae233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:01:17Z,use_quota=True,user_id='06772499180f4d0aafc043bdc12f62ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:01:22 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Creating volume 87d6eeb7-019b-4ace-a47f-5cdff7cd9957 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:01:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:22 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:01:22 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:01:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:22 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:01:22 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:01:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-87d6eeb7-019b-4ace-a47f-5cdff7cd9957 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:22 devstack sudo[109598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-87d6eeb7-019b-4ace-a47f-5cdff7cd9957 1073741824 Jun 24 10:01:22 devstack sudo[109598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:22 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-3b96a53d-603f-4a12-aa91-cd00b4385e99 tempest-VolumesSnapshotListTestJSON-1490763852 None] Create snapshot completed successfully Jun 24 10:01:23 devstack sudo[109598]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-87d6eeb7-019b-4ace-a47f-5cdff7cd9957 1073741824" returned: 0 in 0.928s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-87d6eeb7-019b-4ace-a47f-5cdff7cd9957 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1506e2d1-6825-400c-b7d9-47745a170a27 tempest-VolumesSnapshotListTestJSON-1490763852 None] Acquiring lock "cinder-cdbf6d71-66a7-4769-ab27-2b305cd8932c-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:23 devstack sudo[109604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-87d6eeb7-019b-4ace-a47f-5cdff7cd9957 Jun 24 10:01:23 devstack sudo[109604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1506e2d1-6825-400c-b7d9-47745a170a27 tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "cinder-cdbf6d71-66a7-4769-ab27-2b305cd8932c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1506e2d1-6825-400c-b7d9-47745a170a27 tempest-VolumesSnapshotListTestJSON-1490763852 None] Acquiring lock "cinder-quobyte-1364ad5f-25aa-413a-849c-f08a00b5a803" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1506e2d1-6825-400c-b7d9-47745a170a27 tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "cinder-quobyte-1364ad5f-25aa-413a-849c-f08a00b5a803" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1506e2d1-6825-400c-b7d9-47745a170a27 tempest-VolumesSnapshotListTestJSON-1490763852 None] Acquiring lock "cinder-quobyte-cdbf6d71-66a7-4769-ab27-2b305cd8932c" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1506e2d1-6825-400c-b7d9-47745a170a27 tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "cinder-quobyte-cdbf6d71-66a7-4769-ab27-2b305cd8932c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:23 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-1506e2d1-6825-400c-b7d9-47745a170a27 tempest-VolumesSnapshotListTestJSON-1490763852 None] Deleting offline snapshot cdbf6d71-66a7-4769-ab27-2b305cd8932c of volume 1364ad5f-25aa-413a-849c-f08a00b5a803 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 10:01:23 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-1506e2d1-6825-400c-b7d9-47745a170a27 tempest-VolumesSnapshotListTestJSON-1490763852 None] snapshot_file for this snap is: volume-1364ad5f-25aa-413a-849c-f08a00b5a803.cdbf6d71-66a7-4769-ab27-2b305cd8932c {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 10:01:23 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[915f7539-6af4-4fe7-8820-3f3ec0c4e203]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1506e2d1-6825-400c-b7d9-47745a170a27 tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.cdbf6d71-66a7-4769-ab27-2b305cd8932c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:23 devstack sudo[109606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.cdbf6d71-66a7-4769-ab27-2b305cd8932c Jun 24 10:01:23 devstack sudo[109606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:24 devstack sudo[109604]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-87d6eeb7-019b-4ace-a47f-5cdff7cd9957" returned: 0 in 0.645s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.237s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "cinder-quobyte-271f4e4c-38af-432f-926d-d2b1c022458a-ade69b63-c0b4-4b5c-88c9-5a01cf16c180" by "_create_volume_from_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f740c6-3423-48d2-86e7-7225edce4071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87d6eeb7-019b-4ace-a47f-5cdff7cd9957', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6934081b-181a-48e3-bac7-90dd29226521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-271f4e4c-38af-432f-926d-d2b1c022458a-ade69b63-c0b4-4b5c-88c9-5a01cf16c180" acquired by "_create_volume_from_snapshot" :: waited 0.083s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Creating volume ade69b63-c0b4-4b5c-88c9-5a01cf16c180 from snapshot 271f4e4c-38af-432f-926d-d2b1c022458a {{(pid=93447) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "cinder-quobyte-ade69b63-c0b4-4b5c-88c9-5a01cf16c180" by "_copy_volume_from_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:24 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Volume volume-87d6eeb7-019b-4ace-a47f-5cdff7cd9957 (87d6eeb7-019b-4ace-a47f-5cdff7cd9957): created successfully Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6934081b-181a-48e3-bac7-90dd29226521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Flow 'volume_create_manager' (fd13bb5a-0261-4d6f-83e2-d14461b7fafa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-ade69b63-c0b4-4b5c-88c9-5a01cf16c180" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] snapshot: 271f4e4c-38af-432f-926d-d2b1c022458a, volume: ade69b63-c0b4-4b5c-88c9-5a01cf16c180, {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 10:01:24 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-71640177-150f-49c7-9c4d-61a2ddffdbf4 tempest-CinderUnicodeTest-632623150 None] Created volume successfully. Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc3bf3e-319b-4c6d-ac79-194e0619b074]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.271f4e4c-38af-432f-926d-d2b1c022458a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:24 devstack sudo[109606]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1506e2d1-6825-400c-b7d9-47745a170a27 tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.cdbf6d71-66a7-4769-ab27-2b305cd8932c" returned: 0 in 0.816s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-1506e2d1-6825-400c-b7d9-47745a170a27 tempest-VolumesSnapshotListTestJSON-1490763852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1364ad5f-25aa-413a-849c-f08a00b5a803(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f00f7a-aa4e-4d15-a031-3819fd82ff57]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1506e2d1-6825-400c-b7d9-47745a170a27 tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:24 devstack sudo[109612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.271f4e4c-38af-432f-926d-d2b1c022458a Jun 24 10:01:24 devstack sudo[109612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:24 devstack sudo[109614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18 Jun 24 10:01:24 devstack sudo[109614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:25 devstack sudo[109650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:01:25 devstack sudo[109650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Flow 'volume_create_manager' (61ca1960-071e-4f1f-bfc7-29441265b8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f04aa3-bfdb-46d0-bd8e-9d7e122acc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f04aa3-bfdb-46d0-bd8e-9d7e122acc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:01:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1110095942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34213d5-0e89-4dd0-80a5-4bd20ad7cee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081b903017ed453da03fdcff321ae233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:01:25Z,use_quota=True,user_id='06772499180f4d0aafc043bdc12f62ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79cfee4-cee9-4b36-b35a-57ba2ce857dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79cfee4-cee9-4b36-b35a-57ba2ce857dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:25 devstack sudo[109614]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3653ca33-639f-4f49-bdcb-087e3ed054b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3653ca33-639f-4f49-bdcb-087e3ed054b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f34213d5-0e89-4dd0-80a5-4bd20ad7cee1', 'volume_name': 'volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b08ec6-21a0-4fbf-9a4d-8233dbe61635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b08ec6-21a0-4fbf-9a4d-8233dbe61635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff20e816-261c-4580-abb1-e51661c507da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:25 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Volume f34213d5-0e89-4dd0-80a5-4bd20ad7cee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1', 'volume_size': 1} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1506e2d1-6825-400c-b7d9-47745a170a27 tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18" returned: 0 in 0.956s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-1506e2d1-6825-400c-b7d9-47745a170a27 tempest-VolumesSnapshotListTestJSON-1490763852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1364ad5f-25aa-413a-849c-f08a00b5a803(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1506e2d1-6825-400c-b7d9-47745a170a27 tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.cdbf6d71-66a7-4769-ab27-2b305cd8932c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:25 devstack sudo[109612]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.271f4e4c-38af-432f-926d-d2b1c022458a" returned: 0 in 1.091s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a18a71c-558c-4a07-a593-ab6cf16a3385(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Creating direct copy from snapshot {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 10:01:25 devstack sudo[109661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.cdbf6d71-66a7-4769-ab27-2b305cd8932c Jun 24 10:01:25 devstack sudo[109661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[855ddad4-202a-4d75-a025-29d8e0755959]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:25 devstack sudo[109663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 Jun 24 10:01:25 devstack sudo[109663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:25 devstack sudo[109650]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.869s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 28 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 10:01:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 10:01:26 devstack sudo[109663]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385" returned: 0 in 0.792s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:26 devstack cinder-volume[93447]: DEBUG cinder.utils [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Path /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ade69b63-c0b4-4b5c-88c9-5a01cf16c180 not found in is_blk_device check {{(pid=93447) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 10:01:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ade69b63-c0b4-4b5c-88c9-5a01cf16c180 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:26 devstack sudo[109661]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1506e2d1-6825-400c-b7d9-47745a170a27 tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.cdbf6d71-66a7-4769-ab27-2b305cd8932c" returned: 0 in 0.843s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1506e2d1-6825-400c-b7d9-47745a170a27 tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.cdbf6d71-66a7-4769-ab27-2b305cd8932c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:26 devstack sudo[109673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ade69b63-c0b4-4b5c-88c9-5a01cf16c180 Jun 24 10:01:26 devstack sudo[109673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:26 devstack sudo[109674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.cdbf6d71-66a7-4769-ab27-2b305cd8932c Jun 24 10:01:26 devstack sudo[109674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:27 devstack sudo[109674]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1506e2d1-6825-400c-b7d9-47745a170a27 tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.cdbf6d71-66a7-4769-ab27-2b305cd8932c" returned: 0 in 0.641s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1506e2d1-6825-400c-b7d9-47745a170a27 tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "cinder-quobyte-cdbf6d71-66a7-4769-ab27-2b305cd8932c" released by "_delete_snapshot" :: held 3.358s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1506e2d1-6825-400c-b7d9-47745a170a27 tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "cinder-quobyte-1364ad5f-25aa-413a-849c-f08a00b5a803" released by "delete_snapshot" :: held 3.379s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:27 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-1506e2d1-6825-400c-b7d9-47745a170a27 tempest-VolumesSnapshotListTestJSON-1490763852 None] Created reservations ['eb8769af-7be3-42ee-b2ed-d49e0792053f', 'cd67b16a-4208-46a9-ab5b-522d1fb0e26e', 'f0a515ed-ec6a-4430-8aea-b12034532caf', 'b7eaac4d-1581-4e22-97e3-67c09b3caaee'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:01:27 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-1506e2d1-6825-400c-b7d9-47745a170a27 tempest-VolumesSnapshotListTestJSON-1490763852 None] Delete snapshot completed successfully. Jun 24 10:01:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1506e2d1-6825-400c-b7d9-47745a170a27 tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "cinder-cdbf6d71-66a7-4769-ab27-2b305cd8932c-delete_snapshot" released by "delete_snapshot" :: held 3.623s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:28 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b39fa6fd-24d6-40ab-a8cc-5822b04ad37c tempest-VolumesSnapshotListTestJSON-1490763852 None] Acquiring lock "cinder-e6f1f96b-7d56-4f08-b150-2e23ee721c18-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:28 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b39fa6fd-24d6-40ab-a8cc-5822b04ad37c tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "cinder-e6f1f96b-7d56-4f08-b150-2e23ee721c18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:28 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b39fa6fd-24d6-40ab-a8cc-5822b04ad37c tempest-VolumesSnapshotListTestJSON-1490763852 None] Acquiring lock "cinder-quobyte-1364ad5f-25aa-413a-849c-f08a00b5a803" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:28 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b39fa6fd-24d6-40ab-a8cc-5822b04ad37c tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "cinder-quobyte-1364ad5f-25aa-413a-849c-f08a00b5a803" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:28 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b39fa6fd-24d6-40ab-a8cc-5822b04ad37c tempest-VolumesSnapshotListTestJSON-1490763852 None] Acquiring lock "cinder-quobyte-e6f1f96b-7d56-4f08-b150-2e23ee721c18" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:28 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b39fa6fd-24d6-40ab-a8cc-5822b04ad37c tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "cinder-quobyte-e6f1f96b-7d56-4f08-b150-2e23ee721c18" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:28 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-b39fa6fd-24d6-40ab-a8cc-5822b04ad37c tempest-VolumesSnapshotListTestJSON-1490763852 None] Deleting offline snapshot e6f1f96b-7d56-4f08-b150-2e23ee721c18 of volume 1364ad5f-25aa-413a-849c-f08a00b5a803 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 10:01:28 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-b39fa6fd-24d6-40ab-a8cc-5822b04ad37c tempest-VolumesSnapshotListTestJSON-1490763852 None] snapshot_file for this snap is: volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 10:01:28 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6775748d-7956-44b0-889a-4423a6c8f8b6]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b39fa6fd-24d6-40ab-a8cc-5822b04ad37c tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:28 devstack sudo[109689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18 Jun 24 10:01:28 devstack sudo[109689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:29 devstack sudo[109689]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b39fa6fd-24d6-40ab-a8cc-5822b04ad37c tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18" returned: 0 in 1.573s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:29 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-b39fa6fd-24d6-40ab-a8cc-5822b04ad37c tempest-VolumesSnapshotListTestJSON-1490763852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1364ad5f-25aa-413a-849c-f08a00b5a803(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:01:29 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5dd845-a4ae-4d6c-95c2-22babf2a563e]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b39fa6fd-24d6-40ab-a8cc-5822b04ad37c tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:30 devstack sudo[109694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785 Jun 24 10:01:30 devstack sudo[109694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:31 devstack sudo[109694]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b39fa6fd-24d6-40ab-a8cc-5822b04ad37c tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785" returned: 0 in 1.480s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:31 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-b39fa6fd-24d6-40ab-a8cc-5822b04ad37c tempest-VolumesSnapshotListTestJSON-1490763852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1364ad5f-25aa-413a-849c-f08a00b5a803(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:01:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b39fa6fd-24d6-40ab-a8cc-5822b04ad37c tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:31 devstack sudo[109700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18 Jun 24 10:01:31 devstack sudo[109700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:31 devstack sudo[109673]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ade69b63-c0b4-4b5c-88c9-5a01cf16c180" returned: 0 in 5.045s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:31 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6ae9b5-1397-41c5-9819-9c198abb6083]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:31 devstack sudo[109702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 Jun 24 10:01:31 devstack sudo[109702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:32 devstack sudo[109700]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b39fa6fd-24d6-40ab-a8cc-5822b04ad37c tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18" returned: 0 in 0.756s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b39fa6fd-24d6-40ab-a8cc-5822b04ad37c tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:32 devstack sudo[109710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18 Jun 24 10:01:32 devstack sudo[109710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:32 devstack sudo[109702]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385" returned: 0 in 0.938s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:32 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385, size 1024.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ade69b63-c0b4-4b5c-88c9-5a01cf16c180 {{(pid=93447) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 10:01:32 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Converted 1024.00 MB image at 202.94 MB/s Jun 24 10:01:32 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ade69b63-c0b4-4b5c-88c9-5a01cf16c180 is being set with open permissions: ugo+rw Jun 24 10:01:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ade69b63-c0b4-4b5c-88c9-5a01cf16c180 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:32 devstack sudo[109713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ade69b63-c0b4-4b5c-88c9-5a01cf16c180 Jun 24 10:01:32 devstack sudo[109713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:32 devstack sudo[109710]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b39fa6fd-24d6-40ab-a8cc-5822b04ad37c tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.e6f1f96b-7d56-4f08-b150-2e23ee721c18" returned: 0 in 0.663s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:32 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b39fa6fd-24d6-40ab-a8cc-5822b04ad37c tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "cinder-quobyte-e6f1f96b-7d56-4f08-b150-2e23ee721c18" released by "_delete_snapshot" :: held 4.644s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:32 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b39fa6fd-24d6-40ab-a8cc-5822b04ad37c tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "cinder-quobyte-1364ad5f-25aa-413a-849c-f08a00b5a803" released by "delete_snapshot" :: held 4.697s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:32 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-b39fa6fd-24d6-40ab-a8cc-5822b04ad37c tempest-VolumesSnapshotListTestJSON-1490763852 None] Created reservations ['8be94a55-cbaa-43fd-9aa9-0374046f510e', 'bd7539cd-a346-439c-b621-2b09d53e8cfc', 'ce34261e-e7c1-4ad7-ab60-63d2523f55a3', 'ebe3ec78-29bd-431a-9102-65847f562cd1'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:01:32 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-b39fa6fd-24d6-40ab-a8cc-5822b04ad37c tempest-VolumesSnapshotListTestJSON-1490763852 None] Delete snapshot completed successfully. Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b39fa6fd-24d6-40ab-a8cc-5822b04ad37c tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "cinder-e6f1f96b-7d56-4f08-b150-2e23ee721c18-delete_snapshot" released by "delete_snapshot" :: held 4.865s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:33 devstack sudo[109713]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ade69b63-c0b4-4b5c-88c9-5a01cf16c180" returned: 0 in 0.633s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-ade69b63-c0b4-4b5c-88c9-5a01cf16c180" released by "_copy_volume_from_snapshot" :: held 8.603s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-271f4e4c-38af-432f-926d-d2b1c022458a-ade69b63-c0b4-4b5c-88c9-5a01cf16c180" released by "_create_volume_from_snapshot" :: held 8.654s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.739s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.481s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:01:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1110095942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34213d5-0e89-4dd0-80a5-4bd20ad7cee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081b903017ed453da03fdcff321ae233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:01:25Z,use_quota=True,user_id='06772499180f4d0aafc043bdc12f62ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Creating volume f34213d5-0e89-4dd0-80a5-4bd20ad7cee1 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:01:33 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:33 devstack sudo[109717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1 1073741824 Jun 24 10:01:33 devstack sudo[109717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2783681c-1057-4aaf-a7ba-76371f841b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ade69b63-c0b4-4b5c-88c9-5a01cf16c180', 'volume_size': 2, 'snapshot_id': '271f4e4c-38af-432f-926d-d2b1c022458a'}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986bef0a-2093-4b95-b8a5-50402917082c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:33 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Volume volume-ade69b63-c0b4-4b5c-88c9-5a01cf16c180 (ade69b63-c0b4-4b5c-88c9-5a01cf16c180): created successfully Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986bef0a-2093-4b95-b8a5-50402917082c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Flow 'volume_create_manager' (0cadbfd6-b08e-46dd-bf8d-7e86e83c27d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:01:33 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-bd376adf-fafe-4304-a0a6-997897cbbb41 tempest-VolumesSnapshotTestJSON-1010016385 None] Created volume successfully. Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4ac3cec8-a626-4c1d-b3bd-1a19a82826b7 tempest-VolumesSnapshotListTestJSON-1490763852 None] Acquiring lock "cinder-b5dba170-0049-4c77-bc41-c5680e0e9785-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4ac3cec8-a626-4c1d-b3bd-1a19a82826b7 tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "cinder-b5dba170-0049-4c77-bc41-c5680e0e9785-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4ac3cec8-a626-4c1d-b3bd-1a19a82826b7 tempest-VolumesSnapshotListTestJSON-1490763852 None] Acquiring lock "cinder-quobyte-1364ad5f-25aa-413a-849c-f08a00b5a803" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4ac3cec8-a626-4c1d-b3bd-1a19a82826b7 tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "cinder-quobyte-1364ad5f-25aa-413a-849c-f08a00b5a803" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4ac3cec8-a626-4c1d-b3bd-1a19a82826b7 tempest-VolumesSnapshotListTestJSON-1490763852 None] Acquiring lock "cinder-quobyte-b5dba170-0049-4c77-bc41-c5680e0e9785" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4ac3cec8-a626-4c1d-b3bd-1a19a82826b7 tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "cinder-quobyte-b5dba170-0049-4c77-bc41-c5680e0e9785" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-4ac3cec8-a626-4c1d-b3bd-1a19a82826b7 tempest-VolumesSnapshotListTestJSON-1490763852 None] Deleting offline snapshot b5dba170-0049-4c77-bc41-c5680e0e9785 of volume 1364ad5f-25aa-413a-849c-f08a00b5a803 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-4ac3cec8-a626-4c1d-b3bd-1a19a82826b7 tempest-VolumesSnapshotListTestJSON-1490763852 None] snapshot_file for this snap is: volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[558fffb4-8a00-4e3c-94f2-43e3e84498f2]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4ac3cec8-a626-4c1d-b3bd-1a19a82826b7 tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:33 devstack sudo[109719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785 Jun 24 10:01:33 devstack sudo[109719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:33 devstack sudo[109717]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1 1073741824" returned: 0 in 0.798s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:33 devstack sudo[109725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1 Jun 24 10:01:33 devstack sudo[109725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:34 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-70155996-3238-407e-8a9b-7702d7e999c3 tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "cinder-ade69b63-c0b4-4b5c-88c9-5a01cf16c180-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:34 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-70155996-3238-407e-8a9b-7702d7e999c3 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-ade69b63-c0b4-4b5c-88c9-5a01cf16c180-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:34 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-70155996-3238-407e-8a9b-7702d7e999c3 tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "cinder-quobyte-ade69b63-c0b4-4b5c-88c9-5a01cf16c180" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:34 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-70155996-3238-407e-8a9b-7702d7e999c3 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-ade69b63-c0b4-4b5c-88c9-5a01cf16c180" acquired by "delete_volume" :: waited 0.018s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:34 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ee2348-f919-493f-8226-b91ca4fe1c1d]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-70155996-3238-407e-8a9b-7702d7e999c3 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ade69b63-c0b4-4b5c-88c9-5a01cf16c180 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:34 devstack sudo[109719]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4ac3cec8-a626-4c1d-b3bd-1a19a82826b7 tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785" returned: 0 in 0.841s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:34 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-4ac3cec8-a626-4c1d-b3bd-1a19a82826b7 tempest-VolumesSnapshotListTestJSON-1490763852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1364ad5f-25aa-413a-849c-f08a00b5a803(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:01:34 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb88db6-c90f-46c8-9533-325da3671e92]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4ac3cec8-a626-4c1d-b3bd-1a19a82826b7 tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:34 devstack sudo[109730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ade69b63-c0b4-4b5c-88c9-5a01cf16c180 Jun 24 10:01:34 devstack sudo[109730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:34 devstack sudo[109731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803 Jun 24 10:01:34 devstack sudo[109731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:34 devstack sudo[109725]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1" returned: 0 in 0.714s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:34 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:01:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff20e816-261c-4580-abb1-e51661c507da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc790a4-25b6-4804-a184-401f2912a43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:34 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Volume volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1 (f34213d5-0e89-4dd0-80a5-4bd20ad7cee1): created successfully Jun 24 10:01:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc790a4-25b6-4804-a184-401f2912a43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:34 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Flow 'volume_create_manager' (61ca1960-071e-4f1f-bfc7-29441265b8d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:01:34 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-0485c713-47d1-4bbb-90b5-48cf3aa5b246 tempest-CinderUnicodeTest-632623150 None] Created volume successfully. Jun 24 10:01:35 devstack sudo[109730]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-70155996-3238-407e-8a9b-7702d7e999c3 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ade69b63-c0b4-4b5c-88c9-5a01cf16c180" returned: 0 in 0.759s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-70155996-3238-407e-8a9b-7702d7e999c3 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ade69b63-c0b4-4b5c-88c9-5a01cf16c180 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:35 devstack sudo[109741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ade69b63-c0b4-4b5c-88c9-5a01cf16c180 Jun 24 10:01:35 devstack sudo[109741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:35 devstack sudo[109731]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4ac3cec8-a626-4c1d-b3bd-1a19a82826b7 tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803" returned: 0 in 0.771s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4ac3cec8-a626-4c1d-b3bd-1a19a82826b7 tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:35 devstack sudo[109743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785 Jun 24 10:01:35 devstack sudo[109743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8d755bab-c6a7-46cc-8758-26c4019b45db tempest-CinderUnicodeTest-632623150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8d755bab-c6a7-46cc-8758-26c4019b45db tempest-CinderUnicodeTest-632623150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:35 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-8d755bab-c6a7-46cc-8758-26c4019b45db tempest-CinderUnicodeTest-632623150 None] Creating offline snapshot 7bf4de50-af9f-453f-bd1e-e117a6d0d51f of volume f34213d5-0e89-4dd0-80a5-4bd20ad7cee1 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 10:01:35 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebab95bf-afbd-4ca2-bdb6-b54fe70e88ce]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8d755bab-c6a7-46cc-8758-26c4019b45db tempest-CinderUnicodeTest-632623150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:35 devstack sudo[109745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1 Jun 24 10:01:35 devstack sudo[109745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:35 devstack sudo[109741]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-70155996-3238-407e-8a9b-7702d7e999c3 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ade69b63-c0b4-4b5c-88c9-5a01cf16c180" returned: 0 in 0.672s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:35 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-70155996-3238-407e-8a9b-7702d7e999c3 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-ade69b63-c0b4-4b5c-88c9-5a01cf16c180" released by "delete_volume" :: held 1.479s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:35 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-70155996-3238-407e-8a9b-7702d7e999c3 tempest-VolumesSnapshotTestJSON-1010016385 None] Created reservations ['0d143904-7642-40c9-8c86-00822e0f442e', '558ac023-4d5b-4d4e-ad41-c2b151c80960', 'b50b81a3-002c-4fee-8e12-b398e00d6033', '135edbf8-7f0d-49f4-be7e-6838cc4622e2'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:01:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-70155996-3238-407e-8a9b-7702d7e999c3 tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-70155996-3238-407e-8a9b-7702d7e999c3 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:35 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-70155996-3238-407e-8a9b-7702d7e999c3 tempest-VolumesSnapshotTestJSON-1010016385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:01:35 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-70155996-3238-407e-8a9b-7702d7e999c3 tempest-VolumesSnapshotTestJSON-1010016385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:01:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-70155996-3238-407e-8a9b-7702d7e999c3 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-70155996-3238-407e-8a9b-7702d7e999c3 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:35 devstack sudo[109751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:01:35 devstack sudo[109751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:36 devstack sudo[109743]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4ac3cec8-a626-4c1d-b3bd-1a19a82826b7 tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785" returned: 0 in 0.843s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4ac3cec8-a626-4c1d-b3bd-1a19a82826b7 tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:36 devstack sudo[109753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785 Jun 24 10:01:36 devstack sudo[109753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:36 devstack sudo[109745]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8d755bab-c6a7-46cc-8758-26c4019b45db tempest-CinderUnicodeTest-632623150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1" returned: 0 in 0.800s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8d755bab-c6a7-46cc-8758-26c4019b45db tempest-CinderUnicodeTest-632623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.7bf4de50-af9f-453f-bd1e-e117a6d0d51f 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:36 devstack sudo[109758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.7bf4de50-af9f-453f-bd1e-e117a6d0d51f 1G Jun 24 10:01:36 devstack sudo[109758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4f2105e8-1642-4de2-aea7-98a8fc48f2fe tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "cinder-271f4e4c-38af-432f-926d-d2b1c022458a-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4f2105e8-1642-4de2-aea7-98a8fc48f2fe tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-271f4e4c-38af-432f-926d-d2b1c022458a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4f2105e8-1642-4de2-aea7-98a8fc48f2fe tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "cinder-quobyte-5a18a71c-558c-4a07-a593-ab6cf16a3385" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4f2105e8-1642-4de2-aea7-98a8fc48f2fe tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-5a18a71c-558c-4a07-a593-ab6cf16a3385" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:36 devstack sudo[109751]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4f2105e8-1642-4de2-aea7-98a8fc48f2fe tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "cinder-quobyte-271f4e4c-38af-432f-926d-d2b1c022458a" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-70155996-3238-407e-8a9b-7702d7e999c3 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.745s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:36 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-70155996-3238-407e-8a9b-7702d7e999c3 tempest-VolumesSnapshotTestJSON-1010016385 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:01:36 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-70155996-3238-407e-8a9b-7702d7e999c3 tempest-VolumesSnapshotTestJSON-1010016385 None] Deleted volume successfully. Jun 24 10:01:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4f2105e8-1642-4de2-aea7-98a8fc48f2fe tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-271f4e4c-38af-432f-926d-d2b1c022458a" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-4f2105e8-1642-4de2-aea7-98a8fc48f2fe tempest-VolumesSnapshotTestJSON-1010016385 None] Deleting offline snapshot 271f4e4c-38af-432f-926d-d2b1c022458a of volume 5a18a71c-558c-4a07-a593-ab6cf16a3385 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 10:01:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-4f2105e8-1642-4de2-aea7-98a8fc48f2fe tempest-VolumesSnapshotTestJSON-1010016385 None] snapshot_file for this snap is: volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.271f4e4c-38af-432f-926d-d2b1c022458a {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 10:01:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-70155996-3238-407e-8a9b-7702d7e999c3 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-ade69b63-c0b4-4b5c-88c9-5a01cf16c180-delete_volume" released by "delete_volume" :: held 2.478s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:36 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78a21e1-40cd-494c-9ce9-929cab281e9e]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4f2105e8-1642-4de2-aea7-98a8fc48f2fe tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.271f4e4c-38af-432f-926d-d2b1c022458a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:36 devstack sudo[109753]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4ac3cec8-a626-4c1d-b3bd-1a19a82826b7 tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803.b5dba170-0049-4c77-bc41-c5680e0e9785" returned: 0 in 0.726s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4ac3cec8-a626-4c1d-b3bd-1a19a82826b7 tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "cinder-quobyte-b5dba170-0049-4c77-bc41-c5680e0e9785" released by "_delete_snapshot" :: held 3.286s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4ac3cec8-a626-4c1d-b3bd-1a19a82826b7 tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "cinder-quobyte-1364ad5f-25aa-413a-849c-f08a00b5a803" released by "delete_snapshot" :: held 3.312s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:36 devstack sudo[109762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.271f4e4c-38af-432f-926d-d2b1c022458a Jun 24 10:01:36 devstack sudo[109762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:36 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-4ac3cec8-a626-4c1d-b3bd-1a19a82826b7 tempest-VolumesSnapshotListTestJSON-1490763852 None] Created reservations ['d3bba8cc-04e2-4ff7-84a6-f9b6d4ad2fea', '4cb51f11-6851-40cf-93eb-3b2a41bd6333', '29192d7a-7732-4431-bc44-75931c68a526', '93e2ea66-e4b6-4d9a-9628-43857799089d'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:01:36 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-4ac3cec8-a626-4c1d-b3bd-1a19a82826b7 tempest-VolumesSnapshotListTestJSON-1490763852 None] Delete snapshot completed successfully. Jun 24 10:01:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4ac3cec8-a626-4c1d-b3bd-1a19a82826b7 tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "cinder-b5dba170-0049-4c77-bc41-c5680e0e9785-delete_snapshot" released by "delete_snapshot" :: held 3.450s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:37 devstack sudo[109758]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8d755bab-c6a7-46cc-8758-26c4019b45db tempest-CinderUnicodeTest-632623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.7bf4de50-af9f-453f-bd1e-e117a6d0d51f 1G" returned: 0 in 0.872s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8d755bab-c6a7-46cc-8758-26c4019b45db tempest-CinderUnicodeTest-632623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.7bf4de50-af9f-453f-bd1e-e117a6d0d51f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:37 devstack sudo[109767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.7bf4de50-af9f-453f-bd1e-e117a6d0d51f Jun 24 10:01:37 devstack sudo[109767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:37 devstack sudo[109762]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4f2105e8-1642-4de2-aea7-98a8fc48f2fe tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.271f4e4c-38af-432f-926d-d2b1c022458a" returned: 0 in 0.775s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:37 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-4f2105e8-1642-4de2-aea7-98a8fc48f2fe tempest-VolumesSnapshotTestJSON-1010016385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a18a71c-558c-4a07-a593-ab6cf16a3385(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:01:37 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[88069bb7-fc85-470d-95f3-21896e3f2113]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4f2105e8-1642-4de2-aea7-98a8fc48f2fe tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:37 devstack sudo[109772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 Jun 24 10:01:37 devstack sudo[109772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:37 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-6a2d963f-660d-42e6-a3e2-26495c90c5e6 tempest-VolumesSnapshotListTestJSON-1490763852 None] Acquiring lock "cinder-1364ad5f-25aa-413a-849c-f08a00b5a803-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:37 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-6a2d963f-660d-42e6-a3e2-26495c90c5e6 tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "cinder-1364ad5f-25aa-413a-849c-f08a00b5a803-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:37 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-6a2d963f-660d-42e6-a3e2-26495c90c5e6 tempest-VolumesSnapshotListTestJSON-1490763852 None] Acquiring lock "cinder-quobyte-1364ad5f-25aa-413a-849c-f08a00b5a803" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:37 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-6a2d963f-660d-42e6-a3e2-26495c90c5e6 tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "cinder-quobyte-1364ad5f-25aa-413a-849c-f08a00b5a803" acquired by "delete_volume" :: waited 0.019s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:37 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ceb12a6-41ed-44d2-80b0-d1fab7f9797b]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6a2d963f-660d-42e6-a3e2-26495c90c5e6 tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:38 devstack sudo[109767]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8d755bab-c6a7-46cc-8758-26c4019b45db tempest-CinderUnicodeTest-632623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.7bf4de50-af9f-453f-bd1e-e117a6d0d51f" returned: 0 in 0.765s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:38 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-8d755bab-c6a7-46cc-8758-26c4019b45db tempest-CinderUnicodeTest-632623150 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.7bf4de50-af9f-453f-bd1e-e117a6d0d51f is being set with open permissions: ugo+rw Jun 24 10:01:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8d755bab-c6a7-46cc-8758-26c4019b45db tempest-CinderUnicodeTest-632623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.7bf4de50-af9f-453f-bd1e-e117a6d0d51f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:38 devstack sudo[109778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803 Jun 24 10:01:38 devstack sudo[109778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:38 devstack sudo[109779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.7bf4de50-af9f-453f-bd1e-e117a6d0d51f Jun 24 10:01:38 devstack sudo[109779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:38 devstack sudo[109772]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4f2105e8-1642-4de2-aea7-98a8fc48f2fe tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385" returned: 0 in 0.859s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4f2105e8-1642-4de2-aea7-98a8fc48f2fe tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.271f4e4c-38af-432f-926d-d2b1c022458a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:38 devstack sudo[109785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.271f4e4c-38af-432f-926d-d2b1c022458a Jun 24 10:01:38 devstack sudo[109785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:38 devstack sudo[109779]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8d755bab-c6a7-46cc-8758-26c4019b45db tempest-CinderUnicodeTest-632623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.7bf4de50-af9f-453f-bd1e-e117a6d0d51f" returned: 0 in 0.652s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8d755bab-c6a7-46cc-8758-26c4019b45db tempest-CinderUnicodeTest-632623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:38 devstack sudo[109778]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6a2d963f-660d-42e6-a3e2-26495c90c5e6 tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803" returned: 0 in 0.818s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6a2d963f-660d-42e6-a3e2-26495c90c5e6 tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:38 devstack sudo[109792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.info Jun 24 10:01:38 devstack sudo[109792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:38 devstack sudo[109794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803 Jun 24 10:01:38 devstack sudo[109794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:39 devstack sudo[109785]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4f2105e8-1642-4de2-aea7-98a8fc48f2fe tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.271f4e4c-38af-432f-926d-d2b1c022458a" returned: 0 in 0.810s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4f2105e8-1642-4de2-aea7-98a8fc48f2fe tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.271f4e4c-38af-432f-926d-d2b1c022458a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:39 devstack sudo[109800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.271f4e4c-38af-432f-926d-d2b1c022458a Jun 24 10:01:39 devstack sudo[109800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:39 devstack sudo[109792]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8d755bab-c6a7-46cc-8758-26c4019b45db tempest-CinderUnicodeTest-632623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.info" returned: 0 in 0.681s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:39 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-8d755bab-c6a7-46cc-8758-26c4019b45db tempest-CinderUnicodeTest-632623150 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.info is being set with open permissions: ugo+rw Jun 24 10:01:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8d755bab-c6a7-46cc-8758-26c4019b45db tempest-CinderUnicodeTest-632623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:39 devstack sudo[109804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.info Jun 24 10:01:39 devstack sudo[109804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:39 devstack sudo[109794]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6a2d963f-660d-42e6-a3e2-26495c90c5e6 tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1364ad5f-25aa-413a-849c-f08a00b5a803" returned: 0 in 0.731s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-6a2d963f-660d-42e6-a3e2-26495c90c5e6 tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "cinder-quobyte-1364ad5f-25aa-413a-849c-f08a00b5a803" released by "delete_volume" :: held 1.616s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:39 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-6a2d963f-660d-42e6-a3e2-26495c90c5e6 tempest-VolumesSnapshotListTestJSON-1490763852 None] Created reservations ['99dbe656-fd11-4515-82d3-95e4b62fe307', '1c241d2b-bfae-43ff-93e0-a2aaac8e924b', 'bb0b8b32-e903-43de-8f78-bbf986b9f253', '06dff333-08b0-4438-88fb-dd32f5d887ff'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:01:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6a2d963f-660d-42e6-a3e2-26495c90c5e6 tempest-VolumesSnapshotListTestJSON-1490763852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6a2d963f-660d-42e6-a3e2-26495c90c5e6 tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6a2d963f-660d-42e6-a3e2-26495c90c5e6 tempest-VolumesSnapshotListTestJSON-1490763852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:01:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6a2d963f-660d-42e6-a3e2-26495c90c5e6 tempest-VolumesSnapshotListTestJSON-1490763852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:01:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6a2d963f-660d-42e6-a3e2-26495c90c5e6 tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6a2d963f-660d-42e6-a3e2-26495c90c5e6 tempest-VolumesSnapshotListTestJSON-1490763852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:39 devstack sudo[109806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:01:39 devstack sudo[109806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:39 devstack sudo[109800]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4f2105e8-1642-4de2-aea7-98a8fc48f2fe tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385.271f4e4c-38af-432f-926d-d2b1c022458a" returned: 0 in 0.710s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4f2105e8-1642-4de2-aea7-98a8fc48f2fe tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-271f4e4c-38af-432f-926d-d2b1c022458a" released by "_delete_snapshot" :: held 3.270s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4f2105e8-1642-4de2-aea7-98a8fc48f2fe tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-5a18a71c-558c-4a07-a593-ab6cf16a3385" released by "delete_snapshot" :: held 3.310s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:40 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-4f2105e8-1642-4de2-aea7-98a8fc48f2fe tempest-VolumesSnapshotTestJSON-1010016385 None] Created reservations ['d9aa68af-b72a-4b18-bcd9-63370c12b58f', '966a8045-a5ff-4c61-a7f9-4ec42ec8bbc1', 'bb8bd372-a36a-433c-adcb-516520251dec', '5de32e49-9b2e-4bc8-a7e2-b069a0d33de9'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:01:40 devstack sudo[109804]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8d755bab-c6a7-46cc-8758-26c4019b45db tempest-CinderUnicodeTest-632623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.info" returned: 0 in 0.651s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8d755bab-c6a7-46cc-8758-26c4019b45db tempest-CinderUnicodeTest-632623150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.533s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:40 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-8d755bab-c6a7-46cc-8758-26c4019b45db tempest-CinderUnicodeTest-632623150 None] Create snapshot completed successfully Jun 24 10:01:40 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-4f2105e8-1642-4de2-aea7-98a8fc48f2fe tempest-VolumesSnapshotTestJSON-1010016385 None] Delete snapshot completed successfully. Jun 24 10:01:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4f2105e8-1642-4de2-aea7-98a8fc48f2fe tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-271f4e4c-38af-432f-926d-d2b1c022458a-delete_snapshot" released by "delete_snapshot" :: held 3.509s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:40 devstack sudo[109806]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6a2d963f-660d-42e6-a3e2-26495c90c5e6 tempest-VolumesSnapshotListTestJSON-1490763852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.703s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:40 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-6a2d963f-660d-42e6-a3e2-26495c90c5e6 tempest-VolumesSnapshotListTestJSON-1490763852 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:01:40 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-6a2d963f-660d-42e6-a3e2-26495c90c5e6 tempest-VolumesSnapshotListTestJSON-1490763852 None] Deleted volume successfully. Jun 24 10:01:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-6a2d963f-660d-42e6-a3e2-26495c90c5e6 tempest-VolumesSnapshotListTestJSON-1490763852 None] Lock "cinder-1364ad5f-25aa-413a-849c-f08a00b5a803-delete_volume" released by "delete_volume" :: held 2.529s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-92ab7b02-b710-445f-89dd-320311fca990 tempest-CinderUnicodeTest-632623150 None] Acquiring lock "cinder-7bf4de50-af9f-453f-bd1e-e117a6d0d51f-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-92ab7b02-b710-445f-89dd-320311fca990 tempest-CinderUnicodeTest-632623150 None] Lock "cinder-7bf4de50-af9f-453f-bd1e-e117a6d0d51f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-92ab7b02-b710-445f-89dd-320311fca990 tempest-CinderUnicodeTest-632623150 None] Acquiring lock "cinder-quobyte-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-92ab7b02-b710-445f-89dd-320311fca990 tempest-CinderUnicodeTest-632623150 None] Lock "cinder-quobyte-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-92ab7b02-b710-445f-89dd-320311fca990 tempest-CinderUnicodeTest-632623150 None] Acquiring lock "cinder-quobyte-7bf4de50-af9f-453f-bd1e-e117a6d0d51f" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-92ab7b02-b710-445f-89dd-320311fca990 tempest-CinderUnicodeTest-632623150 None] Lock "cinder-quobyte-7bf4de50-af9f-453f-bd1e-e117a6d0d51f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-92ab7b02-b710-445f-89dd-320311fca990 tempest-CinderUnicodeTest-632623150 None] Deleting offline snapshot 7bf4de50-af9f-453f-bd1e-e117a6d0d51f of volume f34213d5-0e89-4dd0-80a5-4bd20ad7cee1 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 10:01:41 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-92ab7b02-b710-445f-89dd-320311fca990 tempest-CinderUnicodeTest-632623150 None] snapshot_file for this snap is: volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.7bf4de50-af9f-453f-bd1e-e117a6d0d51f {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 10:01:41 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3afaf7b-3bd0-4a7c-8d60-0a56f7f8d731]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-92ab7b02-b710-445f-89dd-320311fca990 tempest-CinderUnicodeTest-632623150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.7bf4de50-af9f-453f-bd1e-e117a6d0d51f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-404d8295-2cf6-4996-925f-334687c8253b tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "cinder-5a18a71c-558c-4a07-a593-ab6cf16a3385-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-404d8295-2cf6-4996-925f-334687c8253b tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-5a18a71c-558c-4a07-a593-ab6cf16a3385-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-404d8295-2cf6-4996-925f-334687c8253b tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "cinder-quobyte-5a18a71c-558c-4a07-a593-ab6cf16a3385" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-404d8295-2cf6-4996-925f-334687c8253b tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-5a18a71c-558c-4a07-a593-ab6cf16a3385" acquired by "delete_volume" :: waited 0.016s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:41 devstack sudo[109811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.7bf4de50-af9f-453f-bd1e-e117a6d0d51f Jun 24 10:01:41 devstack sudo[109811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:41 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d656950a-c924-468f-9145-6a80a724152d]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-404d8295-2cf6-4996-925f-334687c8253b tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:41 devstack sudo[109813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 Jun 24 10:01:41 devstack sudo[109813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:41 devstack sudo[109811]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-92ab7b02-b710-445f-89dd-320311fca990 tempest-CinderUnicodeTest-632623150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.7bf4de50-af9f-453f-bd1e-e117a6d0d51f" returned: 0 in 0.893s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:41 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-92ab7b02-b710-445f-89dd-320311fca990 tempest-CinderUnicodeTest-632623150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:01:41 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8a79af-b918-4a17-a817-40c3252139a9]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-92ab7b02-b710-445f-89dd-320311fca990 tempest-CinderUnicodeTest-632623150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-404d8295-2cf6-4996-925f-334687c8253b tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385" returned: 0 in 0.864s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:42 devstack sudo[109813]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-404d8295-2cf6-4996-925f-334687c8253b tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:42 devstack sudo[109822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1 Jun 24 10:01:42 devstack sudo[109822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:42 devstack sudo[109824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385 Jun 24 10:01:42 devstack sudo[109824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:42 devstack sudo[109824]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-404d8295-2cf6-4996-925f-334687c8253b tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5a18a71c-558c-4a07-a593-ab6cf16a3385" returned: 0 in 0.682s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:42 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-404d8295-2cf6-4996-925f-334687c8253b tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-5a18a71c-558c-4a07-a593-ab6cf16a3385" released by "delete_volume" :: held 1.628s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:42 devstack sudo[109822]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-92ab7b02-b710-445f-89dd-320311fca990 tempest-CinderUnicodeTest-632623150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1" returned: 0 in 0.855s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-92ab7b02-b710-445f-89dd-320311fca990 tempest-CinderUnicodeTest-632623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.7bf4de50-af9f-453f-bd1e-e117a6d0d51f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:42 devstack sudo[109831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.7bf4de50-af9f-453f-bd1e-e117a6d0d51f Jun 24 10:01:42 devstack sudo[109831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:42 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-404d8295-2cf6-4996-925f-334687c8253b tempest-VolumesSnapshotTestJSON-1010016385 None] Created reservations ['4399076a-d7ad-4705-a1af-ae491ee758e3', 'ba4075a8-87e8-4c14-a3eb-efb0af4d79ff', '13e5d4b4-d875-4899-9161-c1cdd32822bc', '8c71ea5d-b698-4940-86d2-766f46ce1808'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:01:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-404d8295-2cf6-4996-925f-334687c8253b tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-404d8295-2cf6-4996-925f-334687c8253b tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-404d8295-2cf6-4996-925f-334687c8253b tempest-VolumesSnapshotTestJSON-1010016385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:01:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-404d8295-2cf6-4996-925f-334687c8253b tempest-VolumesSnapshotTestJSON-1010016385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:01:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-404d8295-2cf6-4996-925f-334687c8253b tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-404d8295-2cf6-4996-925f-334687c8253b tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:42 devstack sudo[109833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:01:42 devstack sudo[109833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:43 devstack sudo[109831]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-92ab7b02-b710-445f-89dd-320311fca990 tempest-CinderUnicodeTest-632623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.7bf4de50-af9f-453f-bd1e-e117a6d0d51f" returned: 0 in 0.881s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-92ab7b02-b710-445f-89dd-320311fca990 tempest-CinderUnicodeTest-632623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.7bf4de50-af9f-453f-bd1e-e117a6d0d51f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:43 devstack sudo[109840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.7bf4de50-af9f-453f-bd1e-e117a6d0d51f Jun 24 10:01:43 devstack sudo[109840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:43 devstack sudo[109833]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-404d8295-2cf6-4996-925f-334687c8253b tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.876s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:43 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-404d8295-2cf6-4996-925f-334687c8253b tempest-VolumesSnapshotTestJSON-1010016385 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:01:43 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-404d8295-2cf6-4996-925f-334687c8253b tempest-VolumesSnapshotTestJSON-1010016385 None] Deleted volume successfully. Jun 24 10:01:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-404d8295-2cf6-4996-925f-334687c8253b tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-5a18a71c-558c-4a07-a593-ab6cf16a3385-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Flow 'volume_create_manager' (d7a8fa5d-47c4-4597-88c3-315d9a920cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43248197-813b-4f0e-bb1b-b59f3aa4991b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43248197-813b-4f0e-bb1b-b59f3aa4991b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1538301817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5feb70e3-5cbc-4ed0-ae44-b007769763ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89229ce502b54ba6b5d7e77368f48d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:01:44Z,use_quota=True,user_id='cd3616fb82f34fc7aee1a2da76b3d4f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa24141-bbd5-4cfa-9f1b-51f31833baea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa24141-bbd5-4cfa-9f1b-51f31833baea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634b4cb1-4219-44d8-a1e4-9bbe5754a98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634b4cb1-4219-44d8-a1e4-9bbe5754a98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5feb70e3-5cbc-4ed0-ae44-b007769763ee', 'volume_name': 'volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5951c2-0544-40ab-90d4-bdfb04336880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5951c2-0544-40ab-90d4-bdfb04336880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdeb2aa-02fd-45b3-9e09-ce145d228092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:44 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Volume 5feb70e3-5cbc-4ed0-ae44-b007769763ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee', 'volume_size': 1} Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1538301817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5feb70e3-5cbc-4ed0-ae44-b007769763ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89229ce502b54ba6b5d7e77368f48d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:01:44Z,use_quota=True,user_id='cd3616fb82f34fc7aee1a2da76b3d4f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Creating volume 5feb70e3-5cbc-4ed0-ae44-b007769763ee {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:01:44 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:44 devstack sudo[109842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee 1073741824 Jun 24 10:01:44 devstack sudo[109842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:44 devstack sudo[109840]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-92ab7b02-b710-445f-89dd-320311fca990 tempest-CinderUnicodeTest-632623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1.7bf4de50-af9f-453f-bd1e-e117a6d0d51f" returned: 0 in 0.853s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-92ab7b02-b710-445f-89dd-320311fca990 tempest-CinderUnicodeTest-632623150 None] Lock "cinder-quobyte-7bf4de50-af9f-453f-bd1e-e117a6d0d51f" released by "_delete_snapshot" :: held 3.598s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-92ab7b02-b710-445f-89dd-320311fca990 tempest-CinderUnicodeTest-632623150 None] Lock "cinder-quobyte-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1" released by "delete_snapshot" :: held 3.626s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-92ab7b02-b710-445f-89dd-320311fca990 tempest-CinderUnicodeTest-632623150 None] Created reservations ['bde46a62-2ace-4bfa-aff0-4c440d4fb207', '7a33cc29-1616-4acc-af89-54b317786f42', '7e363841-d593-48da-9800-dcabc83f5028', 'f7db5c82-c1f9-4b60-800a-db8c7c2a431e'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:01:44 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-92ab7b02-b710-445f-89dd-320311fca990 tempest-CinderUnicodeTest-632623150 None] Delete snapshot completed successfully. Jun 24 10:01:44 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-92ab7b02-b710-445f-89dd-320311fca990 tempest-CinderUnicodeTest-632623150 None] Lock "cinder-7bf4de50-af9f-453f-bd1e-e117a6d0d51f-delete_snapshot" released by "delete_snapshot" :: held 3.776s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:45 devstack sudo[109842]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee 1073741824" returned: 0 in 0.898s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:45 devstack sudo[109849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee Jun 24 10:01:45 devstack sudo[109849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-44a367db-e811-485a-8e83-234ab12552da tempest-CinderUnicodeTest-632623150 None] Acquiring lock "cinder-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-44a367db-e811-485a-8e83-234ab12552da tempest-CinderUnicodeTest-632623150 None] Lock "cinder-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-44a367db-e811-485a-8e83-234ab12552da tempest-CinderUnicodeTest-632623150 None] Acquiring lock "cinder-quobyte-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-44a367db-e811-485a-8e83-234ab12552da tempest-CinderUnicodeTest-632623150 None] Lock "cinder-quobyte-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1" acquired by "delete_volume" :: waited 0.021s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:45 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0be318b-33e9-4af7-9332-97d53605a22c]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-44a367db-e811-485a-8e83-234ab12552da tempest-CinderUnicodeTest-632623150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:45 devstack sudo[109851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1 Jun 24 10:01:45 devstack sudo[109851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:45 devstack sudo[109849]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee" returned: 0 in 0.754s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:45 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:01:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdeb2aa-02fd-45b3-9e09-ce145d228092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7171c067-0147-450c-acf5-d50a5d452e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:45 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Volume volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee (5feb70e3-5cbc-4ed0-ae44-b007769763ee): created successfully Jun 24 10:01:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7171c067-0147-450c-acf5-d50a5d452e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Flow 'volume_create_manager' (d7a8fa5d-47c4-4597-88c3-315d9a920cb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:01:45 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-a5bf95bc-5d00-4630-9b2c-26a658f13caf tempest-VolumesSnapshotTestJSON-1010016385 None] Created volume successfully. Jun 24 10:01:46 devstack sudo[109851]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-44a367db-e811-485a-8e83-234ab12552da tempest-CinderUnicodeTest-632623150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1" returned: 0 in 0.840s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-44a367db-e811-485a-8e83-234ab12552da tempest-CinderUnicodeTest-632623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:46 devstack sudo[109858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1 Jun 24 10:01:46 devstack sudo[109858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6b178be0-0f95-41a3-a745-4904f494ed65 tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6b178be0-0f95-41a3-a745-4904f494ed65 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-6b178be0-0f95-41a3-a745-4904f494ed65 tempest-VolumesSnapshotTestJSON-1010016385 None] Creating offline snapshot 846afaa7-c1cb-4382-b2fe-d452cfc615e3 of volume 5feb70e3-5cbc-4ed0-ae44-b007769763ee {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 10:01:46 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa65ddf-7ad4-4d12-8c38-f459c39201d4]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6b178be0-0f95-41a3-a745-4904f494ed65 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:46 devstack sudo[109860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee Jun 24 10:01:46 devstack sudo[109860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:47 devstack sudo[109858]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-44a367db-e811-485a-8e83-234ab12552da tempest-CinderUnicodeTest-632623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1" returned: 0 in 0.776s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-44a367db-e811-485a-8e83-234ab12552da tempest-CinderUnicodeTest-632623150 None] Lock "cinder-quobyte-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1" released by "delete_volume" :: held 1.689s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:47 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-44a367db-e811-485a-8e83-234ab12552da tempest-CinderUnicodeTest-632623150 None] Created reservations ['9cca423b-96b6-46ef-88cd-bc6d2dd7c22a', 'de11a17c-7725-4ac5-81a3-a8fa09b07563', '6cd1360d-3d69-4b68-8ef3-79e1515eb4aa', '863809e7-353a-49bf-ba02-9ea3593eb5b7'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:01:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-44a367db-e811-485a-8e83-234ab12552da tempest-CinderUnicodeTest-632623150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-44a367db-e811-485a-8e83-234ab12552da tempest-CinderUnicodeTest-632623150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-44a367db-e811-485a-8e83-234ab12552da tempest-CinderUnicodeTest-632623150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:01:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-44a367db-e811-485a-8e83-234ab12552da tempest-CinderUnicodeTest-632623150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:01:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-44a367db-e811-485a-8e83-234ab12552da tempest-CinderUnicodeTest-632623150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-44a367db-e811-485a-8e83-234ab12552da tempest-CinderUnicodeTest-632623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:47 devstack sudo[109860]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6b178be0-0f95-41a3-a745-4904f494ed65 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee" returned: 0 in 0.822s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6b178be0-0f95-41a3-a745-4904f494ed65 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.846afaa7-c1cb-4382-b2fe-d452cfc615e3 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:47 devstack sudo[109866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:01:47 devstack sudo[109866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:47 devstack sudo[109868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.846afaa7-c1cb-4382-b2fe-d452cfc615e3 1G Jun 24 10:01:47 devstack sudo[109868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4f27417d-46b6-48ec-bf9d-731510fa0543 tempest-CinderUnicodeTest-632623150 None] Acquiring lock "cinder-87d6eeb7-019b-4ace-a47f-5cdff7cd9957-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4f27417d-46b6-48ec-bf9d-731510fa0543 tempest-CinderUnicodeTest-632623150 None] Lock "cinder-87d6eeb7-019b-4ace-a47f-5cdff7cd9957-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4f27417d-46b6-48ec-bf9d-731510fa0543 tempest-CinderUnicodeTest-632623150 None] Acquiring lock "cinder-quobyte-87d6eeb7-019b-4ace-a47f-5cdff7cd9957" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4f27417d-46b6-48ec-bf9d-731510fa0543 tempest-CinderUnicodeTest-632623150 None] Lock "cinder-quobyte-87d6eeb7-019b-4ace-a47f-5cdff7cd9957" acquired by "delete_volume" :: waited 0.030s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:47 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[afeac3a8-707b-427c-a186-d2d6d0068458]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4f27417d-46b6-48ec-bf9d-731510fa0543 tempest-CinderUnicodeTest-632623150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-87d6eeb7-019b-4ace-a47f-5cdff7cd9957 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:48 devstack sudo[109870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-87d6eeb7-019b-4ace-a47f-5cdff7cd9957 Jun 24 10:01:48 devstack sudo[109870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:48 devstack sudo[109866]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-44a367db-e811-485a-8e83-234ab12552da tempest-CinderUnicodeTest-632623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.966s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:48 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-44a367db-e811-485a-8e83-234ab12552da tempest-CinderUnicodeTest-632623150 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:01:48 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-44a367db-e811-485a-8e83-234ab12552da tempest-CinderUnicodeTest-632623150 None] Deleted volume successfully. Jun 24 10:01:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-44a367db-e811-485a-8e83-234ab12552da tempest-CinderUnicodeTest-632623150 None] Lock "cinder-f34213d5-0e89-4dd0-80a5-4bd20ad7cee1-delete_volume" released by "delete_volume" :: held 2.921s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:48 devstack sudo[109868]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6b178be0-0f95-41a3-a745-4904f494ed65 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.846afaa7-c1cb-4382-b2fe-d452cfc615e3 1G" returned: 0 in 1.158s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6b178be0-0f95-41a3-a745-4904f494ed65 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.846afaa7-c1cb-4382-b2fe-d452cfc615e3 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:48 devstack sudo[109877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.846afaa7-c1cb-4382-b2fe-d452cfc615e3 Jun 24 10:01:48 devstack sudo[109877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:48 devstack sudo[109870]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4f27417d-46b6-48ec-bf9d-731510fa0543 tempest-CinderUnicodeTest-632623150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-87d6eeb7-019b-4ace-a47f-5cdff7cd9957" returned: 0 in 0.939s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4f27417d-46b6-48ec-bf9d-731510fa0543 tempest-CinderUnicodeTest-632623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-87d6eeb7-019b-4ace-a47f-5cdff7cd9957 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:48 devstack sudo[109882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-87d6eeb7-019b-4ace-a47f-5cdff7cd9957 Jun 24 10:01:48 devstack sudo[109882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:49 devstack sudo[109877]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6b178be0-0f95-41a3-a745-4904f494ed65 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.846afaa7-c1cb-4382-b2fe-d452cfc615e3" returned: 0 in 0.878s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:49 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-6b178be0-0f95-41a3-a745-4904f494ed65 tempest-VolumesSnapshotTestJSON-1010016385 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.846afaa7-c1cb-4382-b2fe-d452cfc615e3 is being set with open permissions: ugo+rw Jun 24 10:01:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6b178be0-0f95-41a3-a745-4904f494ed65 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.846afaa7-c1cb-4382-b2fe-d452cfc615e3 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:49 devstack sudo[109887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.846afaa7-c1cb-4382-b2fe-d452cfc615e3 Jun 24 10:01:49 devstack sudo[109887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:49 devstack sudo[109882]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4f27417d-46b6-48ec-bf9d-731510fa0543 tempest-CinderUnicodeTest-632623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-87d6eeb7-019b-4ace-a47f-5cdff7cd9957" returned: 0 in 0.904s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:49 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4f27417d-46b6-48ec-bf9d-731510fa0543 tempest-CinderUnicodeTest-632623150 None] Lock "cinder-quobyte-87d6eeb7-019b-4ace-a47f-5cdff7cd9957" released by "delete_volume" :: held 1.900s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:49 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-4f27417d-46b6-48ec-bf9d-731510fa0543 tempest-CinderUnicodeTest-632623150 None] Created reservations ['35d7d06a-b7f0-400c-aacc-d6558eee0084', '077ca9ab-071b-4d2a-af35-b6053681b911', '49580422-7577-46df-abd4-77daf9f1bded', '80902071-63e2-4df2-a78e-872f988890dd'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:01:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4f27417d-46b6-48ec-bf9d-731510fa0543 tempest-CinderUnicodeTest-632623150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4f27417d-46b6-48ec-bf9d-731510fa0543 tempest-CinderUnicodeTest-632623150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:49 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4f27417d-46b6-48ec-bf9d-731510fa0543 tempest-CinderUnicodeTest-632623150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:01:49 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4f27417d-46b6-48ec-bf9d-731510fa0543 tempest-CinderUnicodeTest-632623150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:01:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4f27417d-46b6-48ec-bf9d-731510fa0543 tempest-CinderUnicodeTest-632623150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4f27417d-46b6-48ec-bf9d-731510fa0543 tempest-CinderUnicodeTest-632623150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:49 devstack sudo[109890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:01:49 devstack sudo[109890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:50 devstack sudo[109887]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6b178be0-0f95-41a3-a745-4904f494ed65 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.846afaa7-c1cb-4382-b2fe-d452cfc615e3" returned: 0 in 0.893s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6b178be0-0f95-41a3-a745-4904f494ed65 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:50 devstack sudo[109893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.info Jun 24 10:01:50 devstack sudo[109893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:50 devstack sudo[109890]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4f27417d-46b6-48ec-bf9d-731510fa0543 tempest-CinderUnicodeTest-632623150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.858s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:50 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-4f27417d-46b6-48ec-bf9d-731510fa0543 tempest-CinderUnicodeTest-632623150 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:01:50 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-4f27417d-46b6-48ec-bf9d-731510fa0543 tempest-CinderUnicodeTest-632623150 None] Deleted volume successfully. Jun 24 10:01:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-4f27417d-46b6-48ec-bf9d-731510fa0543 tempest-CinderUnicodeTest-632623150 None] Lock "cinder-87d6eeb7-019b-4ace-a47f-5cdff7cd9957-delete_volume" released by "delete_volume" :: held 3.075s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:01:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6b178be0-0f95-41a3-a745-4904f494ed65 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.info" returned: 0 in 0.787s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:50 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-6b178be0-0f95-41a3-a745-4904f494ed65 tempest-VolumesSnapshotTestJSON-1010016385 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.info is being set with open permissions: ugo+rw Jun 24 10:01:50 devstack sudo[109893]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6b178be0-0f95-41a3-a745-4904f494ed65 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:51 devstack sudo[109898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.info Jun 24 10:01:51 devstack sudo[109898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:51 devstack sudo[109898]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6b178be0-0f95-41a3-a745-4904f494ed65 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.info" returned: 0 in 0.702s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6b178be0-0f95-41a3-a745-4904f494ed65 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.419s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:51 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-6b178be0-0f95-41a3-a745-4904f494ed65 tempest-VolumesSnapshotTestJSON-1010016385 None] Create snapshot completed successfully Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Flow 'volume_create_manager' (080167e8-38aa-41de-9140-e83dd2140f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7cb52a5-d803-4e98-bc3a-d826ed694958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7cb52a5-d803-4e98-bc3a-d826ed694958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-491351891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2b4b60b-a1a3-4810-9ce0-1a86fd870e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89229ce502b54ba6b5d7e77368f48d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=846afaa7-c1cb-4382-b2fe-d452cfc615e3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:01:53Z,use_quota=True,user_id='cd3616fb82f34fc7aee1a2da76b3d4f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb74b8b-5be9-4300-a590-1e377d10ba86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb74b8b-5be9-4300-a590-1e377d10ba86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46fc4a0b-c553-4796-9c3c-b93fc6d06189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46fc4a0b-c553-4796-9c3c-b93fc6d06189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a2b4b60b-a1a3-4810-9ce0-1a86fd870e26', 'volume_name': 'volume-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26', 'volume_size': 1, 'snapshot_id': '846afaa7-c1cb-4382-b2fe-d452cfc615e3'}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78f5b8b-5c6a-4e5c-bd27-61612953b683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78f5b8b-5c6a-4e5c-bd27-61612953b683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4abd2ea-8a1e-4411-b977-4178255abcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:01:53 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Volume a2b4b60b-a1a3-4810-9ce0-1a86fd870e26: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26', 'volume_size': 1, 'snapshot_id': '846afaa7-c1cb-4382-b2fe-d452cfc615e3'} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "cinder-quobyte-846afaa7-c1cb-4382-b2fe-d452cfc615e3-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26" by "_create_volume_from_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-846afaa7-c1cb-4382-b2fe-d452cfc615e3-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Creating volume a2b4b60b-a1a3-4810-9ce0-1a86fd870e26 from snapshot 846afaa7-c1cb-4382-b2fe-d452cfc615e3 {{(pid=93447) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "cinder-quobyte-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26" by "_copy_volume_from_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] snapshot: 846afaa7-c1cb-4382-b2fe-d452cfc615e3, volume: a2b4b60b-a1a3-4810-9ce0-1a86fd870e26, {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ca93a2-96b3-42f7-af41-70cb02173480]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.846afaa7-c1cb-4382-b2fe-d452cfc615e3 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:53 devstack sudo[109903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.846afaa7-c1cb-4382-b2fe-d452cfc615e3 Jun 24 10:01:53 devstack sudo[109903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:54 devstack sudo[109903]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.846afaa7-c1cb-4382-b2fe-d452cfc615e3" returned: 0 in 0.801s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:54 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:01:54 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 10:01:54 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Creating direct copy from snapshot {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 10:01:54 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b502729-2125-4c18-808a-70b23d178e15]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:01:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:54 devstack sudo[109911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee Jun 24 10:01:54 devstack sudo[109911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:01:55 devstack sudo[109911]: pam_unix(sudo:session): session closed for user root Jun 24 10:01:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee" returned: 0 in 0.829s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:01:55 devstack cinder-volume[93447]: DEBUG cinder.utils [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Path /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26 not found in is_blk_device check {{(pid=93447) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 10:01:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:01:55 devstack sudo[109916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26 Jun 24 10:01:55 devstack sudo[109916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:00 devstack sudo[109916]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26" returned: 0 in 5.684s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:00 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02c3e82-7991-4022-9e05-57a2088cfeda]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:02:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:00 devstack sudo[109929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee Jun 24 10:02:00 devstack sudo[109929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:01 devstack sudo[109929]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee" returned: 0 in 1.001s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:01 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee, size 1024.00 MB, duration 5.69 sec, destination /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26 {{(pid=93447) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 10:02:01 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Converted 1024.00 MB image at 180.07 MB/s Jun 24 10:02:01 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26 is being set with open permissions: ugo+rw Jun 24 10:02:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:01 devstack sudo[109936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26 Jun 24 10:02:01 devstack sudo[109936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:02 devstack sudo[109936]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26" returned: 0 in 0.722s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26" released by "_copy_volume_from_snapshot" :: held 9.138s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:02:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-846afaa7-c1cb-4382-b2fe-d452cfc615e3-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26" released by "_create_volume_from_snapshot" :: held 9.176s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:02:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.192s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:02:02 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4abd2ea-8a1e-4411-b977-4178255abcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26', 'volume_size': 1, 'snapshot_id': '846afaa7-c1cb-4382-b2fe-d452cfc615e3'}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:02 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906d2959-8e4c-4703-b3e9-440995b169f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:02 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Volume volume-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26 (a2b4b60b-a1a3-4810-9ce0-1a86fd870e26): created successfully Jun 24 10:02:02 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906d2959-8e4c-4703-b3e9-440995b169f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:02 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Flow 'volume_create_manager' (080167e8-38aa-41de-9140-e83dd2140f06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:02:02 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-a0eabb4f-3c8f-45fd-8dae-16c0a98e0bd6 tempest-VolumesSnapshotTestJSON-1010016385 None] Created volume successfully. Jun 24 10:02:03 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ece9f05b-f212-44e6-ba9c-98631277647d tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "cinder-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:02:03 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ece9f05b-f212-44e6-ba9c-98631277647d tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:02:03 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ece9f05b-f212-44e6-ba9c-98631277647d tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "cinder-quobyte-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:02:03 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ece9f05b-f212-44e6-ba9c-98631277647d tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26" acquired by "delete_volume" :: waited 0.017s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:02:03 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f6e1b0-65be-414a-a590-6da83590e817]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:02:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ece9f05b-f212-44e6-ba9c-98631277647d tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:03 devstack sudo[109945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26 Jun 24 10:02:03 devstack sudo[109945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:04 devstack sudo[109945]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ece9f05b-f212-44e6-ba9c-98631277647d tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26" returned: 0 in 0.822s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ece9f05b-f212-44e6-ba9c-98631277647d tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:04 devstack sudo[109950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26 Jun 24 10:02:04 devstack sudo[109950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:04 devstack sudo[109950]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ece9f05b-f212-44e6-ba9c-98631277647d tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26" returned: 0 in 0.724s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:04 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ece9f05b-f212-44e6-ba9c-98631277647d tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26" released by "delete_volume" :: held 1.596s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:02:04 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-ece9f05b-f212-44e6-ba9c-98631277647d tempest-VolumesSnapshotTestJSON-1010016385 None] Created reservations ['69d40eb5-4be6-45be-9fb0-86ece14e0939', '7e602768-b828-44ea-9f05-47c95dd99a28', '0395d094-2cb3-46d4-b9bf-9eeaac519b3c', '44c8b2ff-929a-4ad4-a67a-06177c6f26ba'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:02:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ece9f05b-f212-44e6-ba9c-98631277647d tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:02:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ece9f05b-f212-44e6-ba9c-98631277647d tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:02:05 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ece9f05b-f212-44e6-ba9c-98631277647d tempest-VolumesSnapshotTestJSON-1010016385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:02:05 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ece9f05b-f212-44e6-ba9c-98631277647d tempest-VolumesSnapshotTestJSON-1010016385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:02:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ece9f05b-f212-44e6-ba9c-98631277647d tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:02:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ece9f05b-f212-44e6-ba9c-98631277647d tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:05 devstack sudo[109953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:02:05 devstack sudo[109953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2f683d20-57b5-469a-beef-fa7900ec0ecd tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "cinder-846afaa7-c1cb-4382-b2fe-d452cfc615e3-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:02:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2f683d20-57b5-469a-beef-fa7900ec0ecd tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-846afaa7-c1cb-4382-b2fe-d452cfc615e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:02:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2f683d20-57b5-469a-beef-fa7900ec0ecd tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "cinder-quobyte-5feb70e3-5cbc-4ed0-ae44-b007769763ee" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:02:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2f683d20-57b5-469a-beef-fa7900ec0ecd tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-5feb70e3-5cbc-4ed0-ae44-b007769763ee" acquired by "delete_snapshot" :: waited 0.046s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:02:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2f683d20-57b5-469a-beef-fa7900ec0ecd tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "cinder-quobyte-846afaa7-c1cb-4382-b2fe-d452cfc615e3" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:02:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2f683d20-57b5-469a-beef-fa7900ec0ecd tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-846afaa7-c1cb-4382-b2fe-d452cfc615e3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:02:05 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-2f683d20-57b5-469a-beef-fa7900ec0ecd tempest-VolumesSnapshotTestJSON-1010016385 None] Deleting offline snapshot 846afaa7-c1cb-4382-b2fe-d452cfc615e3 of volume 5feb70e3-5cbc-4ed0-ae44-b007769763ee {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 10:02:05 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-2f683d20-57b5-469a-beef-fa7900ec0ecd tempest-VolumesSnapshotTestJSON-1010016385 None] snapshot_file for this snap is: volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.846afaa7-c1cb-4382-b2fe-d452cfc615e3 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 10:02:05 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[87071470-5d30-43cd-b9aa-88324d2286a3]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:02:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2f683d20-57b5-469a-beef-fa7900ec0ecd tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.846afaa7-c1cb-4382-b2fe-d452cfc615e3 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:05 devstack sudo[109953]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ece9f05b-f212-44e6-ba9c-98631277647d tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.752s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:05 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-ece9f05b-f212-44e6-ba9c-98631277647d tempest-VolumesSnapshotTestJSON-1010016385 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:02:05 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-ece9f05b-f212-44e6-ba9c-98631277647d tempest-VolumesSnapshotTestJSON-1010016385 None] Deleted volume successfully. Jun 24 10:02:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ece9f05b-f212-44e6-ba9c-98631277647d tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-a2b4b60b-a1a3-4810-9ce0-1a86fd870e26-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:02:05 devstack sudo[109956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.846afaa7-c1cb-4382-b2fe-d452cfc615e3 Jun 24 10:02:05 devstack sudo[109956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:06 devstack sudo[109956]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2f683d20-57b5-469a-beef-fa7900ec0ecd tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.846afaa7-c1cb-4382-b2fe-d452cfc615e3" returned: 0 in 0.816s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:06 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-2f683d20-57b5-469a-beef-fa7900ec0ecd tempest-VolumesSnapshotTestJSON-1010016385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:02:06 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9543202-ec4a-41ac-a89f-342468e031cb]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:02:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2f683d20-57b5-469a-beef-fa7900ec0ecd tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:06 devstack sudo[109961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee Jun 24 10:02:06 devstack sudo[109961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:07 devstack sudo[109961]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2f683d20-57b5-469a-beef-fa7900ec0ecd tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee" returned: 0 in 0.814s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2f683d20-57b5-469a-beef-fa7900ec0ecd tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.846afaa7-c1cb-4382-b2fe-d452cfc615e3 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:07 devstack sudo[109966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.846afaa7-c1cb-4382-b2fe-d452cfc615e3 Jun 24 10:02:07 devstack sudo[109966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:08 devstack sudo[109966]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2f683d20-57b5-469a-beef-fa7900ec0ecd tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.846afaa7-c1cb-4382-b2fe-d452cfc615e3" returned: 0 in 0.767s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2f683d20-57b5-469a-beef-fa7900ec0ecd tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.846afaa7-c1cb-4382-b2fe-d452cfc615e3 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:08 devstack sudo[109971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.846afaa7-c1cb-4382-b2fe-d452cfc615e3 Jun 24 10:02:08 devstack sudo[109971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:08 devstack sudo[109971]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2f683d20-57b5-469a-beef-fa7900ec0ecd tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee.846afaa7-c1cb-4382-b2fe-d452cfc615e3" returned: 0 in 0.653s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:08 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2f683d20-57b5-469a-beef-fa7900ec0ecd tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-846afaa7-c1cb-4382-b2fe-d452cfc615e3" released by "_delete_snapshot" :: held 3.165s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:02:08 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2f683d20-57b5-469a-beef-fa7900ec0ecd tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-5feb70e3-5cbc-4ed0-ae44-b007769763ee" released by "delete_snapshot" :: held 3.195s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:02:08 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-2f683d20-57b5-469a-beef-fa7900ec0ecd tempest-VolumesSnapshotTestJSON-1010016385 None] Created reservations ['884a0c42-ad22-48df-808b-b9662c62d3d3', 'e931ccae-acba-46c6-964f-22ca40634ae8', 'f33b375c-4d7a-49d3-9f5a-e8f1e070adc3', 'f877af32-deba-4b87-8654-7a0fe255f920'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:02:09 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-2f683d20-57b5-469a-beef-fa7900ec0ecd tempest-VolumesSnapshotTestJSON-1010016385 None] Delete snapshot completed successfully. Jun 24 10:02:09 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2f683d20-57b5-469a-beef-fa7900ec0ecd tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-846afaa7-c1cb-4382-b2fe-d452cfc615e3-delete_snapshot" released by "delete_snapshot" :: held 3.376s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:02:09 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:02:09 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Flow 'volume_create_manager' (90a043e3-eb29-4aa0-84bc-8815b591d491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:02:09 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (623df0b8-7d3f-4360-b308-a780592e39cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:09 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (623df0b8-7d3f-4360-b308-a780592e39cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-377161322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecbb6617-bced-4bba-b37b-c83d7e0c04e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0f69f5e1a44e649aa609329a8a7f53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:02:10Z,use_quota=True,user_id='583b9ddd3ca943d4bed60f6043894264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4267634-0c26-411a-8987-d3d8631d4c98),volume_type_id=f4267634-0c26-411a-8987-d3d8631d4c98)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:09 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d098ed-5023-4ee8-9b5b-240b97620189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:09 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d098ed-5023-4ee8-9b5b-240b97620189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:09 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2345309-3925-4503-ab80-aa76ca4fa129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:09 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2345309-3925-4503-ab80-aa76ca4fa129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecbb6617-bced-4bba-b37b-c83d7e0c04e4', 'volume_name': 'volume-ecbb6617-bced-4bba-b37b-c83d7e0c04e4', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:09 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b8be39-53c7-4ec9-ae81-6b16b06c9248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:09 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81b8be39-53c7-4ec9-ae81-6b16b06c9248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:09 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8278afb8-dd46-43a0-b32c-de19ee85581f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:09 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Volume ecbb6617-bced-4bba-b37b-c83d7e0c04e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecbb6617-bced-4bba-b37b-c83d7e0c04e4', 'volume_size': 1} Jun 24 10:02:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:02:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:02:09 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-377161322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecbb6617-bced-4bba-b37b-c83d7e0c04e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0f69f5e1a44e649aa609329a8a7f53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:02:10Z,use_quota=True,user_id='583b9ddd3ca943d4bed60f6043894264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4267634-0c26-411a-8987-d3d8631d4c98),volume_type_id=f4267634-0c26-411a-8987-d3d8631d4c98)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:02:09 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Creating volume ecbb6617-bced-4bba-b37b-c83d7e0c04e4 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:02:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:02:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:02:09 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:02:09 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:02:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:02:09 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:02:09 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:02:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ecbb6617-bced-4bba-b37b-c83d7e0c04e4 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:09 devstack sudo[109974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ecbb6617-bced-4bba-b37b-c83d7e0c04e4 1073741824 Jun 24 10:02:09 devstack sudo[109974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:09 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7c11a809-e5c2-4922-b213-8a1590a08a1a tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "cinder-5feb70e3-5cbc-4ed0-ae44-b007769763ee-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7c11a809-e5c2-4922-b213-8a1590a08a1a tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-5feb70e3-5cbc-4ed0-ae44-b007769763ee-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7c11a809-e5c2-4922-b213-8a1590a08a1a tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "cinder-quobyte-5feb70e3-5cbc-4ed0-ae44-b007769763ee" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7c11a809-e5c2-4922-b213-8a1590a08a1a tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-5feb70e3-5cbc-4ed0-ae44-b007769763ee" acquired by "delete_volume" :: waited 0.029s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Flow 'volume_create_manager' (aec90b88-d163-4d93-861b-8eabede82bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948ae339-06f9-4fa3-9ffb-808f05d7a42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c552bb89-7350-4f5e-aa59-2012d7d2ec28]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7c11a809-e5c2-4922-b213-8a1590a08a1a tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948ae339-06f9-4fa3-9ffb-808f05d7a42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1214257195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adba2c84-5085-46ba-b889-0c65188f89cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0f69f5e1a44e649aa609329a8a7f53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:02:10Z,use_quota=True,user_id='583b9ddd3ca943d4bed60f6043894264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e651adb-5516-4905-98e8-8265d8d7cf9a),volume_type_id=8e651adb-5516-4905-98e8-8265d8d7cf9a)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb8dbcf-c476-410c-a7c2-bd55634c4284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cb8dbcf-c476-410c-a7c2-bd55634c4284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b09bee3-90f6-4526-afbf-f01906e40cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b09bee3-90f6-4526-afbf-f01906e40cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adba2c84-5085-46ba-b889-0c65188f89cd', 'volume_name': 'volume-adba2c84-5085-46ba-b889-0c65188f89cd', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79f4ca30-8d92-4585-9e73-8727530e9e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79f4ca30-8d92-4585-9e73-8727530e9e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e04eb1b-7482-4301-a60d-04fe53d44ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:10 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Volume adba2c84-5085-46ba-b889-0c65188f89cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adba2c84-5085-46ba-b889-0c65188f89cd', 'volume_size': 1} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:02:10 devstack sudo[109976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee Jun 24 10:02:10 devstack sudo[109976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:10 devstack sudo[109974]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ecbb6617-bced-4bba-b37b-c83d7e0c04e4 1073741824" returned: 0 in 0.965s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ecbb6617-bced-4bba-b37b-c83d7e0c04e4 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:10 devstack sudo[109982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ecbb6617-bced-4bba-b37b-c83d7e0c04e4 Jun 24 10:02:10 devstack sudo[109982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Flow 'volume_create_manager' (30c121fc-2c29-44e5-a150-6d8d71293135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0560387-8a7f-4c24-916f-9d16b1b87b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0560387-8a7f-4c24-916f-9d16b1b87b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-694258586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49381dd1-a992-44e2-ae34-1bd7770f6c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0f69f5e1a44e649aa609329a8a7f53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:02:11Z,use_quota=True,user_id='583b9ddd3ca943d4bed60f6043894264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0215d9c2-c53e-4bae-869e-7d27391ceeec),volume_type_id=0215d9c2-c53e-4bae-869e-7d27391ceeec)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f0b040-8771-427b-a148-25d9d75a171b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f0b040-8771-427b-a148-25d9d75a171b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62704afa-e54a-494e-abe3-a37f9cf023d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:10 devstack cinder-volume[93447]: DEBUG cinder.image.glance [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Creating Keystone auth plugin from conf {{(pid=93447) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 10:02:11 devstack sudo[109976]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7c11a809-e5c2-4922-b213-8a1590a08a1a tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee" returned: 0 in 0.876s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7c11a809-e5c2-4922-b213-8a1590a08a1a tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:11 devstack sudo[109987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee Jun 24 10:02:11 devstack sudo[109987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62704afa-e54a-494e-abe3-a37f9cf023d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '49381dd1-a992-44e2-ae34-1bd7770f6c6f', 'volume_name': 'volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f', 'volume_size': 1, 'image_id': 'b1c11be5-99a2-4e85-9b97-c2808ec599a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1c11be5-99a2-4e85-9b97-c2808ec599a4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1082072784', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a0f69f5e1a44e649aa609329a8a7f53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b1c11be5-99a2-4e85-9b97-c2808ec599a4', 'created_at': datetime.datetime(2026, 6, 24, 8, 2, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 8, 2, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1c11be5-99a2-4e85-9b97-c2808ec599a4/file', 'properties': {}}, 'image_service': }' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c071a90-ff02-441a-ab32-43e4f47360e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c071a90-ff02-441a-ab32-43e4f47360e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898bfac9-fab1-4c51-bd73-9c6b988369da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:11 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Volume 49381dd1-a992-44e2-ae34-1bd7770f6c6f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f', 'volume_size': 1, 'image_id': 'b1c11be5-99a2-4e85-9b97-c2808ec599a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1c11be5-99a2-4e85-9b97-c2808ec599a4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1082072784', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a0f69f5e1a44e649aa609329a8a7f53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b1c11be5-99a2-4e85-9b97-c2808ec599a4', 'created_at': datetime.datetime(2026, 6, 24, 8, 2, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 8, 2, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1c11be5-99a2-4e85-9b97-c2808ec599a4/file', 'properties': {}}, 'image_service': } Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Trying to clone 49381dd1-a992-44e2-ae34-1bd7770f6c6f from image b1c11be5-99a2-4e85-9b97-c2808ec599a4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b1c11be5-99a2-4e85-9b97-c2808ec599a4', 'metadata': {}}]). {{(pid=93447) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 10:02:11 devstack sudo[109982]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ecbb6617-bced-4bba-b37b-c83d7e0c04e4" returned: 0 in 0.698s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.178s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1214257195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adba2c84-5085-46ba-b889-0c65188f89cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0f69f5e1a44e649aa609329a8a7f53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:02:10Z,use_quota=True,user_id='583b9ddd3ca943d4bed60f6043894264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e651adb-5516-4905-98e8-8265d8d7cf9a),volume_type_id=8e651adb-5516-4905-98e8-8265d8d7cf9a)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Creating volume adba2c84-5085-46ba-b889-0c65188f89cd {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:02:11 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adba2c84-5085-46ba-b889-0c65188f89cd 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8278afb8-dd46-43a0-b32c-de19ee85581f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecbb6617-bced-4bba-b37b-c83d7e0c04e4', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:11 devstack sudo[109990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adba2c84-5085-46ba-b889-0c65188f89cd 1073741824 Jun 24 10:02:11 devstack sudo[109990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb94454-1da9-4b28-8bb2-eae4e7d44bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:11 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Volume volume-ecbb6617-bced-4bba-b37b-c83d7e0c04e4 (ecbb6617-bced-4bba-b37b-c83d7e0c04e4): created successfully Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb94454-1da9-4b28-8bb2-eae4e7d44bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Flow 'volume_create_manager' (90a043e3-eb29-4aa0-84bc-8815b591d491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:02:11 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-4acbbc05-b937-48c3-bd82-7fe0f2f67cc3 tempest-TestInstancesWithCinderVolumes-743389812 None] Created volume successfully. Jun 24 10:02:11 devstack sudo[109987]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7c11a809-e5c2-4922-b213-8a1590a08a1a tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-5feb70e3-5cbc-4ed0-ae44-b007769763ee" returned: 0 in 0.738s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7c11a809-e5c2-4922-b213-8a1590a08a1a tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-5feb70e3-5cbc-4ed0-ae44-b007769763ee" released by "delete_volume" :: held 1.726s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:02:11 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-7c11a809-e5c2-4922-b213-8a1590a08a1a tempest-VolumesSnapshotTestJSON-1010016385 None] Created reservations ['a9629cb5-bd8e-48a0-a9ff-9ec916ff8225', 'dc67880d-20f6-4b65-86f3-1b088a41b16c', 'f3fa7b8c-879d-493c-a9fd-f88c33bd6ebf', '17b7e8b0-0770-4554-a5fb-dd3a950feea2'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:02:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7c11a809-e5c2-4922-b213-8a1590a08a1a tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:02:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7c11a809-e5c2-4922-b213-8a1590a08a1a tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:02:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7c11a809-e5c2-4922-b213-8a1590a08a1a tempest-VolumesSnapshotTestJSON-1010016385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:02:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7c11a809-e5c2-4922-b213-8a1590a08a1a tempest-VolumesSnapshotTestJSON-1010016385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:02:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7c11a809-e5c2-4922-b213-8a1590a08a1a tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:02:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7c11a809-e5c2-4922-b213-8a1590a08a1a tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:12 devstack sudo[109995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:02:12 devstack sudo[109995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-6f9b94ae-2214-4d1d-924a-5a39757e13ee tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "cinder-544f46a8-3587-40e9-b69e-7b7cfc25eb8d-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:02:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-6f9b94ae-2214-4d1d-924a-5a39757e13ee tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-544f46a8-3587-40e9-b69e-7b7cfc25eb8d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:02:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-6f9b94ae-2214-4d1d-924a-5a39757e13ee tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "cinder-quobyte-544f46a8-3587-40e9-b69e-7b7cfc25eb8d" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:02:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-6f9b94ae-2214-4d1d-924a-5a39757e13ee tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-544f46a8-3587-40e9-b69e-7b7cfc25eb8d" acquired by "delete_volume" :: waited 0.023s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:02:12 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e91d3e-1d74-4aa9-ab0e-ec83f187260a]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:02:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6f9b94ae-2214-4d1d-924a-5a39757e13ee tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:12 devstack sudo[109990]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adba2c84-5085-46ba-b889-0c65188f89cd 1073741824" returned: 0 in 1.054s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adba2c84-5085-46ba-b889-0c65188f89cd {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:12 devstack sudo[110001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adba2c84-5085-46ba-b889-0c65188f89cd Jun 24 10:02:12 devstack sudo[110001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:12 devstack sudo[110000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d Jun 24 10:02:12 devstack sudo[110000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:12 devstack sudo[109995]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7c11a809-e5c2-4922-b213-8a1590a08a1a tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.761s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:12 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-7c11a809-e5c2-4922-b213-8a1590a08a1a tempest-VolumesSnapshotTestJSON-1010016385 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:02:12 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-7c11a809-e5c2-4922-b213-8a1590a08a1a tempest-VolumesSnapshotTestJSON-1010016385 None] Deleted volume successfully. Jun 24 10:02:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7c11a809-e5c2-4922-b213-8a1590a08a1a tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-5feb70e3-5cbc-4ed0-ae44-b007769763ee-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:02:13 devstack sudo[110001]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adba2c84-5085-46ba-b889-0c65188f89cd" returned: 0 in 0.684s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:02:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:02:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e04eb1b-7482-4301-a60d-04fe53d44ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adba2c84-5085-46ba-b889-0c65188f89cd', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf61827-319b-4465-818a-f3730ff5aa7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:13 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Volume volume-adba2c84-5085-46ba-b889-0c65188f89cd (adba2c84-5085-46ba-b889-0c65188f89cd): created successfully Jun 24 10:02:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf61827-319b-4465-818a-f3730ff5aa7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Flow 'volume_create_manager' (aec90b88-d163-4d93-861b-8eabede82bad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:02:13 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-24200238-b875-417f-abee-fb94089e7352 tempest-TestInstancesWithCinderVolumes-743389812 None] Created volume successfully. Jun 24 10:02:13 devstack sudo[110000]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6f9b94ae-2214-4d1d-924a-5a39757e13ee tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d" returned: 0 in 0.848s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6f9b94ae-2214-4d1d-924a-5a39757e13ee tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:13 devstack sudo[110010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d Jun 24 10:02:13 devstack sudo[110010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:14 devstack sudo[110010]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6f9b94ae-2214-4d1d-924a-5a39757e13ee tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-544f46a8-3587-40e9-b69e-7b7cfc25eb8d" returned: 0 in 0.705s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:14 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-6f9b94ae-2214-4d1d-924a-5a39757e13ee tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-quobyte-544f46a8-3587-40e9-b69e-7b7cfc25eb8d" released by "delete_volume" :: held 1.616s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:02:14 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-6f9b94ae-2214-4d1d-924a-5a39757e13ee tempest-VolumesSnapshotTestJSON-1010016385 None] Created reservations ['809af614-e629-4a32-94f9-34145cd3c8bf', 'd32df64a-7fad-44c2-974b-95f2d3e19637', 'f9178b5a-6f2a-48be-a8e7-1805d7489b2e', '3cbae539-093e-43f2-9c58-edc39b874574'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:02:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6f9b94ae-2214-4d1d-924a-5a39757e13ee tempest-VolumesSnapshotTestJSON-1010016385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:02:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6f9b94ae-2214-4d1d-924a-5a39757e13ee tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:02:14 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6f9b94ae-2214-4d1d-924a-5a39757e13ee tempest-VolumesSnapshotTestJSON-1010016385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:02:14 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6f9b94ae-2214-4d1d-924a-5a39757e13ee tempest-VolumesSnapshotTestJSON-1010016385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:02:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6f9b94ae-2214-4d1d-924a-5a39757e13ee tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:02:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6f9b94ae-2214-4d1d-924a-5a39757e13ee tempest-VolumesSnapshotTestJSON-1010016385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:14 devstack sudo[110013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:02:14 devstack sudo[110013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:14 devstack sudo[110013]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6f9b94ae-2214-4d1d-924a-5a39757e13ee tempest-VolumesSnapshotTestJSON-1010016385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.642s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:14 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-6f9b94ae-2214-4d1d-924a-5a39757e13ee tempest-VolumesSnapshotTestJSON-1010016385 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:02:14 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-6f9b94ae-2214-4d1d-924a-5a39757e13ee tempest-VolumesSnapshotTestJSON-1010016385 None] Deleted volume successfully. Jun 24 10:02:14 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-6f9b94ae-2214-4d1d-924a-5a39757e13ee tempest-VolumesSnapshotTestJSON-1010016385 None] Lock "cinder-544f46a8-3587-40e9-b69e-7b7cfc25eb8d-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:02:14 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b1c11be5-99a2-4e85-9b97-c2808ec599a4_48q632_jdevstack@QuobyteHD, size 20.69 MB, duration 3.78 sec {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 10:02:14 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Image download 20.69 MB at 5.48 MB/s Jun 24 10:02:14 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf3a84d-a9d2-4e33-80b6-f315911cf694]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:02:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1c11be5-99a2-4e85-9b97-c2808ec599a4_48q632_jdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:15 devstack sudo[110016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1c11be5-99a2-4e85-9b97-c2808ec599a4_48q632_jdevstack@QuobyteHD Jun 24 10:02:15 devstack sudo[110016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:15 devstack sudo[110016]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1c11be5-99a2-4e85-9b97-c2808ec599a4_48q632_jdevstack@QuobyteHD" returned: 0 in 0.749s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:15 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Temporary image b1c11be5-99a2-4e85-9b97-c2808ec599a4 is fetched for user 583b9ddd3ca943d4bed60f6043894264. {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 10:02:15 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a03a5f-a13c-488a-935f-fb8601360d90]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:02:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1c11be5-99a2-4e85-9b97-c2808ec599a4_48q632_jdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:15 devstack sudo[110022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1c11be5-99a2-4e85-9b97-c2808ec599a4_48q632_jdevstack@QuobyteHD Jun 24 10:02:15 devstack sudo[110022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:16 devstack sudo[110022]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1c11be5-99a2-4e85-9b97-c2808ec599a4_48q632_jdevstack@QuobyteHD" returned: 0 in 0.777s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:02:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:02:16 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-694258586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49381dd1-a992-44e2-ae34-1bd7770f6c6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0f69f5e1a44e649aa609329a8a7f53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:02:11Z,use_quota=True,user_id='583b9ddd3ca943d4bed60f6043894264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0215d9c2-c53e-4bae-869e-7d27391ceeec),volume_type_id=0215d9c2-c53e-4bae-869e-7d27391ceeec)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:02:16 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Creating volume 49381dd1-a992-44e2-ae34-1bd7770f6c6f {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:02:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:02:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:02:16 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:02:16 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:02:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:02:16 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:02:16 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:02:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:16 devstack sudo[110027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f 1073741824 Jun 24 10:02:16 devstack sudo[110027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:17 devstack sudo[110027]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f 1073741824" returned: 0 in 0.940s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:17 devstack sudo[110033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f Jun 24 10:02:17 devstack sudo[110033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:18 devstack sudo[110033]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f" returned: 0 in 0.694s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:18 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:02:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:02:18 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Attempting download of b1c11be5-99a2-4e85-9b97-c2808ec599a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/b1c11be5-99a2-4e85-9b97-c2808ec599a4', 'metadata': {}}])) to volume 49381dd1-a992-44e2-ae34-1bd7770f6c6f. {{(pid=93447) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 10:02:18 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8eb2924-f171-4353-9c0d-26665c3ab097]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:02:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1c11be5-99a2-4e85-9b97-c2808ec599a4_51q4f_q4 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:18 devstack sudo[110037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1c11be5-99a2-4e85-9b97-c2808ec599a4_51q4f_q4 Jun 24 10:02:18 devstack sudo[110037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:19 devstack sudo[110037]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1c11be5-99a2-4e85-9b97-c2808ec599a4_51q4f_q4" returned: 0 in 0.757s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1c11be5-99a2-4e85-9b97-c2808ec599a4_51q4f_q4 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:19 devstack sudo[110041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1c11be5-99a2-4e85-9b97-c2808ec599a4_51q4f_q4 Jun 24 10:02:19 devstack sudo[110041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:19 devstack sudo[110041]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1c11be5-99a2-4e85-9b97-c2808ec599a4_51q4f_q4" returned: 1 in 0.743s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1c11be5-99a2-4e85-9b97-c2808ec599a4_51q4f_q4' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:02:19 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da261cf-1eaa-43c8-9836-2142c3823ae6]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:02:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1c11be5-99a2-4e85-9b97-c2808ec599a4_48q632_jdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:19 devstack sudo[110045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1c11be5-99a2-4e85-9b97-c2808ec599a4_48q632_jdevstack@QuobyteHD Jun 24 10:02:19 devstack sudo[110045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:20 devstack sudo[110045]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b1c11be5-99a2-4e85-9b97-c2808ec599a4_48q632_jdevstack@QuobyteHD" returned: 0 in 0.791s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:20 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] b1c11be5-99a2-4e85-9b97-c2808ec599a4 was qcow2, converting to raw {{(pid=93447) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 10:02:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b1c11be5-99a2-4e85-9b97-c2808ec599a4_48q632_jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:20 devstack sudo[110050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b1c11be5-99a2-4e85-9b97-c2808ec599a4_48q632_jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f Jun 24 10:02:20 devstack sudo[110050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:22 devstack sudo[110050]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b1c11be5-99a2-4e85-9b97-c2808ec599a4_48q632_jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f" returned: 0 in 1.956s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:22 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b1c11be5-99a2-4e85-9b97-c2808ec599a4_48q632_jdevstack@QuobyteHD, size 112.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f {{(pid=93447) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 10:02:22 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Converted 112.00 MB image at 57.20 MB/s Jun 24 10:02:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:22 devstack sudo[110059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f 1G Jun 24 10:02:22 devstack sudo[110059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:23 devstack sudo[110059]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f 1G" returned: 0 in 0.737s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:23 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d582538f-71d2-4ca2-a70d-d7394d7e9121]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:02:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:23 devstack sudo[110064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f Jun 24 10:02:23 devstack sudo[110064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:24 devstack sudo[110064]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f" returned: 0 in 0.775s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:24 devstack sudo[110069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f Jun 24 10:02:24 devstack sudo[110069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:25 devstack sudo[110069]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f" returned: 1 in 0.849s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Downloaded image b1c11be5-99a2-4e85-9b97-c2808ec599a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/b1c11be5-99a2-4e85-9b97-c2808ec599a4', 'metadata': {}}])) to volume 49381dd1-a992-44e2-ae34-1bd7770f6c6f successfully. {{(pid=93447) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Temporary image b1c11be5-99a2-4e85-9b97-c2808ec599a4 for user 583b9ddd3ca943d4bed60f6043894264 is deleted. {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Marking volume 49381dd1-a992-44e2-ae34-1bd7770f6c6f as bootable. {{(pid=93447) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=109,cinder:UPDATE=119,cinder:DELETE=10,cinder:INSERT=35 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Copying metadata from image b1c11be5-99a2-4e85-9b97-c2808ec599a4 to 49381dd1-a992-44e2-ae34-1bd7770f6c6f. {{(pid=93447) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Creating volume glance metadata for volume 49381dd1-a992-44e2-ae34-1bd7770f6c6f backed by image b1c11be5-99a2-4e85-9b97-c2808ec599a4 with: {'image_id': 'b1c11be5-99a2-4e85-9b97-c2808ec599a4', 'image_name': 'tempest-scenario-img--1082072784', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93447) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:UPDATE=126,cinder:SELECT=86,cinder:DELETE=9,cinder:INSERT=30 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 10:02:25 devstack sudo[110074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:02:25 devstack sudo[110074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898bfac9-fab1-4c51-bd73-9c6b988369da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f', 'volume_size': 1, 'image_id': 'b1c11be5-99a2-4e85-9b97-c2808ec599a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1c11be5-99a2-4e85-9b97-c2808ec599a4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1082072784', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a0f69f5e1a44e649aa609329a8a7f53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b1c11be5-99a2-4e85-9b97-c2808ec599a4', 'created_at': datetime.datetime(2026, 6, 24, 8, 2, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 8, 2, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1c11be5-99a2-4e85-9b97-c2808ec599a4/file', 'properties': {}}, 'image_service': }' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce13a7f-ae41-45b8-8ae3-f98c53049e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:25 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Volume volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f (49381dd1-a992-44e2-ae34-1bd7770f6c6f): created successfully Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce13a7f-ae41-45b8-8ae3-f98c53049e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Flow 'volume_create_manager' (30c121fc-2c29-44e5-a150-6d8d71293135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:02:25 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-51912c2f-10bd-43c2-981a-eb7fce74ed6a tempest-TestInstancesWithCinderVolumes-743389812 None] Created volume successfully. Jun 24 10:02:25 devstack sudo[110074]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.734s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 28 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 10:02:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 10:02:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-b9261471-3e4f-4a28-9eea-28502dd6e87a req-ddd63f8c-9ba6-470a-811f-8e4db093e90f tempest-TestInstancesWithCinderVolumes-743389812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:02:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-b9261471-3e4f-4a28-9eea-28502dd6e87a req-ddd63f8c-9ba6-470a-811f-8e4db093e90f tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:02:34 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f4dec6-d0b2-4778-8796-6a4a8fdbdf13]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:02:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-b9261471-3e4f-4a28-9eea-28502dd6e87a req-ddd63f8c-9ba6-470a-811f-8e4db093e90f tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:34 devstack sudo[110125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f Jun 24 10:02:34 devstack sudo[110125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:35 devstack sudo[110125]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-b9261471-3e4f-4a28-9eea-28502dd6e87a req-ddd63f8c-9ba6-470a-811f-8e4db093e90f tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f" returned: 0 in 0.918s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-b9261471-3e4f-4a28-9eea-28502dd6e87a req-ddd63f8c-9ba6-470a-811f-8e4db093e90f tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:35 devstack sudo[110129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f Jun 24 10:02:35 devstack sudo[110129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:36 devstack sudo[110129]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-b9261471-3e4f-4a28-9eea-28502dd6e87a req-ddd63f8c-9ba6-470a-811f-8e4db093e90f tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f" returned: 1 in 0.869s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-b9261471-3e4f-4a28-9eea-28502dd6e87a req-ddd63f8c-9ba6-470a-811f-8e4db093e90f tempest-TestInstancesWithCinderVolumes-743389812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:02:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-b9261471-3e4f-4a28-9eea-28502dd6e87a req-ddd63f8c-9ba6-470a-811f-8e4db093e90f tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.836s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:02:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-b9261471-3e4f-4a28-9eea-28502dd6e87a req-ddd63f8c-9ba6-470a-811f-8e4db093e90f tempest-TestInstancesWithCinderVolumes-743389812 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb', 'name': 'volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '34b63eaf-abe2-4fec-af42-b2878769568e', 'enforce_multipath': True} {{(pid=93447) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 10:02:36 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-b9261471-3e4f-4a28-9eea-28502dd6e87a req-ddd63f8c-9ba6-470a-811f-8e4db093e90f tempest-TestInstancesWithCinderVolumes-743389812 None] attachment_update completed successfully. Jun 24 10:02:44 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:02:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Flow 'volume_create_manager' (eb67c4e0-e25a-4c25-a647-9266957feb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:02:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eaf1640-91c0-479d-b07e-132a9f9ceffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eaf1640-91c0-479d-b07e-132a9f9ceffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1668067549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef61f34-7b2e-4313-8803-4e5e5af22834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d075f0eae484a72be1056fb553758c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:02:44Z,use_quota=True,user_id='6a0c6fa35f824f219a10722a31868a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27188460-e3e2-4404-bc7d-12b9260025e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27188460-e3e2-4404-bc7d-12b9260025e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0824a3c6-539d-4436-a5d5-966ced549624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0824a3c6-539d-4436-a5d5-966ced549624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ef61f34-7b2e-4313-8803-4e5e5af22834', 'volume_name': 'volume-8ef61f34-7b2e-4313-8803-4e5e5af22834', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd6175f-ec50-46ec-9e8d-14ddb4506417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd6175f-ec50-46ec-9e8d-14ddb4506417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1642f2-43de-4428-98dd-fa4daa8ab9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:44 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Volume 8ef61f34-7b2e-4313-8803-4e5e5af22834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ef61f34-7b2e-4313-8803-4e5e5af22834', 'volume_size': 1} Jun 24 10:02:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:02:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:02:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1668067549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef61f34-7b2e-4313-8803-4e5e5af22834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d075f0eae484a72be1056fb553758c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:02:44Z,use_quota=True,user_id='6a0c6fa35f824f219a10722a31868a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:02:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Creating volume 8ef61f34-7b2e-4313-8803-4e5e5af22834 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:02:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:02:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:02:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:02:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:02:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:02:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:02:44 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:02:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:44 devstack sudo[110597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 1073741824 Jun 24 10:02:44 devstack sudo[110597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:45 devstack sudo[110597]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 1073741824" returned: 0 in 0.929s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:02:45 devstack sudo[110607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 Jun 24 10:02:45 devstack sudo[110607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:02:45 devstack sudo[110607]: pam_unix(sudo:session): session closed for user root Jun 24 10:02:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834" returned: 0 in 0.652s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:02:45 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:02:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:02:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1642f2-43de-4428-98dd-fa4daa8ab9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ef61f34-7b2e-4313-8803-4e5e5af22834', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (996f6f16-640c-41d8-b567-b0b1859d2558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:02:45 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Volume volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 (8ef61f34-7b2e-4313-8803-4e5e5af22834): created successfully Jun 24 10:02:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (996f6f16-640c-41d8-b567-b0b1859d2558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:02:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Flow 'volume_create_manager' (eb67c4e0-e25a-4c25-a647-9266957feb7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:02:45 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-f22a170e-844b-40cc-9621-e173519f85ca tempest-TestStampPattern-2058151550 None] Created volume successfully. Jun 24 10:02:55 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=15,cinder:INSERT=6,cinder:UPDATE=7 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 10:02:55 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:INSERT=3,cinder:SELECT=9,cinder:UPDATE=6,cinder:DELETE=2 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 10:03:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-7c63ff36-ef68-442a-b4ce-65aa255ee6ab req-55a83263-32ee-402c-94a8-bc990fe2332d tempest-TestInstancesWithCinderVolumes-743389812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:03:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-7c63ff36-ef68-442a-b4ce-65aa255ee6ab req-55a83263-32ee-402c-94a8-bc990fe2332d tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:03:18 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e2c2cd-ce18-4a9e-bca0-48b1ea09e7c0]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:03:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-7c63ff36-ef68-442a-b4ce-65aa255ee6ab req-55a83263-32ee-402c-94a8-bc990fe2332d tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ecbb6617-bced-4bba-b37b-c83d7e0c04e4 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:03:18 devstack sudo[110866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ecbb6617-bced-4bba-b37b-c83d7e0c04e4 Jun 24 10:03:18 devstack sudo[110866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:03:19 devstack sudo[110866]: pam_unix(sudo:session): session closed for user root Jun 24 10:03:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-7c63ff36-ef68-442a-b4ce-65aa255ee6ab req-55a83263-32ee-402c-94a8-bc990fe2332d tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ecbb6617-bced-4bba-b37b-c83d7e0c04e4" returned: 0 in 0.794s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:03:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-7c63ff36-ef68-442a-b4ce-65aa255ee6ab req-55a83263-32ee-402c-94a8-bc990fe2332d tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.819s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:03:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-7c63ff36-ef68-442a-b4ce-65aa255ee6ab req-55a83263-32ee-402c-94a8-bc990fe2332d tempest-TestInstancesWithCinderVolumes-743389812 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb', 'name': 'volume-ecbb6617-bced-4bba-b37b-c83d7e0c04e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '857ab479-aed4-4570-b862-c381bbfeb517', 'enforce_multipath': True} {{(pid=93447) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 10:03:19 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-7c63ff36-ef68-442a-b4ce-65aa255ee6ab req-55a83263-32ee-402c-94a8-bc990fe2332d tempest-TestInstancesWithCinderVolumes-743389812 None] attachment_update completed successfully. Jun 24 10:03:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 10:03:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:03:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:03:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:03:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:03:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:03:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:03:25 devstack sudo[110893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:03:25 devstack sudo[110893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:03:25 devstack sudo[110893]: pam_unix(sudo:session): session closed for user root Jun 24 10:03:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.626s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:03:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:03:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 10:03:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 28 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 10:03:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 10:03:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-f7935d1e-ea3e-48a6-8123-3c2b65ad24d6 req-95743399-11ef-47fb-a0af-acc8329e08ac tempest-TestInstancesWithCinderVolumes-743389812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:03:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-f7935d1e-ea3e-48a6-8123-3c2b65ad24d6 req-95743399-11ef-47fb-a0af-acc8329e08ac tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:03:26 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7e0ccb-6bd8-4603-b3fd-6d94838a736b]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:03:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-f7935d1e-ea3e-48a6-8123-3c2b65ad24d6 req-95743399-11ef-47fb-a0af-acc8329e08ac tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adba2c84-5085-46ba-b889-0c65188f89cd {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:03:27 devstack sudo[110940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adba2c84-5085-46ba-b889-0c65188f89cd Jun 24 10:03:27 devstack sudo[110940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:03:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-f582d7ba-2c45-4062-a8c1-52fd4f1147cb req-27dab2cc-d434-49eb-913b-938edad0041d tempest-TestStampPattern-2058151550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:03:27 devstack sudo[110940]: pam_unix(sudo:session): session closed for user root Jun 24 10:03:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-f7935d1e-ea3e-48a6-8123-3c2b65ad24d6 req-95743399-11ef-47fb-a0af-acc8329e08ac tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adba2c84-5085-46ba-b889-0c65188f89cd" returned: 0 in 0.751s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:03:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-f7935d1e-ea3e-48a6-8123-3c2b65ad24d6 req-95743399-11ef-47fb-a0af-acc8329e08ac tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.767s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:03:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-f582d7ba-2c45-4062-a8c1-52fd4f1147cb req-27dab2cc-d434-49eb-913b-938edad0041d tempest-TestStampPattern-2058151550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.400s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:03:27 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0ac11e-82ec-4ac7-baef-ab632b68f4f3]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:03:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-f582d7ba-2c45-4062-a8c1-52fd4f1147cb req-27dab2cc-d434-49eb-913b-938edad0041d tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:03:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-f7935d1e-ea3e-48a6-8123-3c2b65ad24d6 req-95743399-11ef-47fb-a0af-acc8329e08ac tempest-TestInstancesWithCinderVolumes-743389812 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb', 'name': 'volume-adba2c84-5085-46ba-b889-0c65188f89cd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85431f07-9b10-45b8-b671-84b6019135b8', 'enforce_multipath': True} {{(pid=93447) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 10:03:27 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-f7935d1e-ea3e-48a6-8123-3c2b65ad24d6 req-95743399-11ef-47fb-a0af-acc8329e08ac tempest-TestInstancesWithCinderVolumes-743389812 None] attachment_update completed successfully. Jun 24 10:03:27 devstack sudo[110953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 Jun 24 10:03:27 devstack sudo[110953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:03:28 devstack sudo[110953]: pam_unix(sudo:session): session closed for user root Jun 24 10:03:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-f582d7ba-2c45-4062-a8c1-52fd4f1147cb req-27dab2cc-d434-49eb-913b-938edad0041d tempest-TestStampPattern-2058151550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834" returned: 0 in 0.810s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:03:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-f582d7ba-2c45-4062-a8c1-52fd4f1147cb req-27dab2cc-d434-49eb-913b-938edad0041d tempest-TestStampPattern-2058151550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.826s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:03:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-f582d7ba-2c45-4062-a8c1-52fd4f1147cb req-27dab2cc-d434-49eb-913b-938edad0041d tempest-TestStampPattern-2058151550 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb', 'name': 'volume-8ef61f34-7b2e-4313-8803-4e5e5af22834', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86ce00d3-7417-46c8-b164-f385ffb68f63', 'enforce_multipath': True} {{(pid=93447) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 10:03:28 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-f582d7ba-2c45-4062-a8c1-52fd4f1147cb req-27dab2cc-d434-49eb-913b-938edad0041d tempest-TestStampPattern-2058151550 None] attachment_update completed successfully. Jun 24 10:03:36 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-967eb84b-030d-4d3c-990b-734521076c7d req-aa59f209-e152-40a3-8cc3-8d2fe72352a8 tempest-TestStampPattern-2058151550 None] Terminate volume connection completed successfully. Jun 24 10:03:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-967eb84b-030d-4d3c-990b-734521076c7d req-aa59f209-e152-40a3-8cc3-8d2fe72352a8 tempest-TestStampPattern-2058151550 None] Deleting attachment 86ce00d3-7417-46c8-b164-f385ffb68f63. {{(pid=93447) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 10:03:37 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-072608bc-b22d-4c6f-9db8-bd7d16c2a855 req-a98ba919-fc39-4731-a042-d8ea3cbc62d6 tempest-TestInstancesWithCinderVolumes-743389812 None] Terminate volume connection completed successfully. Jun 24 10:03:37 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-072608bc-b22d-4c6f-9db8-bd7d16c2a855 req-a98ba919-fc39-4731-a042-d8ea3cbc62d6 tempest-TestInstancesWithCinderVolumes-743389812 None] Deleting attachment 857ab479-aed4-4570-b862-c381bbfeb517. {{(pid=93447) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 10:03:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2b0e2e52-7b50-435e-9bf2-804d27f3855b tempest-TestStampPattern-2058151550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:03:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2b0e2e52-7b50-435e-9bf2-804d27f3855b tempest-TestStampPattern-2058151550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:03:38 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-2b0e2e52-7b50-435e-9bf2-804d27f3855b tempest-TestStampPattern-2058151550 None] Creating offline snapshot faf59bb2-5311-441e-83fc-3690a8880ae9 of volume 8ef61f34-7b2e-4313-8803-4e5e5af22834 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 10:03:38 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be0cc97-10ad-4590-adbf-7aebe95aa2a9]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:03:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2b0e2e52-7b50-435e-9bf2-804d27f3855b tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:03:38 devstack sudo[111030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 Jun 24 10:03:38 devstack sudo[111030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:03:38 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0b0dad69-9a27-450d-9789-abd2df202ddd tempest-TestInstancesWithCinderVolumes-743389812 None] Acquiring lock "cinder-ecbb6617-bced-4bba-b37b-c83d7e0c04e4-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:03:38 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0b0dad69-9a27-450d-9789-abd2df202ddd tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "cinder-ecbb6617-bced-4bba-b37b-c83d7e0c04e4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:03:38 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0b0dad69-9a27-450d-9789-abd2df202ddd tempest-TestInstancesWithCinderVolumes-743389812 None] Acquiring lock "cinder-quobyte-ecbb6617-bced-4bba-b37b-c83d7e0c04e4" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:03:38 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0b0dad69-9a27-450d-9789-abd2df202ddd tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "cinder-quobyte-ecbb6617-bced-4bba-b37b-c83d7e0c04e4" acquired by "delete_volume" :: waited 0.022s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:03:39 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3542e4fa-d884-4ade-8691-244880ce6fcc]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:03:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0b0dad69-9a27-450d-9789-abd2df202ddd tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ecbb6617-bced-4bba-b37b-c83d7e0c04e4 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:03:39 devstack sudo[111036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ecbb6617-bced-4bba-b37b-c83d7e0c04e4 Jun 24 10:03:39 devstack sudo[111036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:03:39 devstack sudo[111030]: pam_unix(sudo:session): session closed for user root Jun 24 10:03:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2b0e2e52-7b50-435e-9bf2-804d27f3855b tempest-TestStampPattern-2058151550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834" returned: 0 in 0.766s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:03:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2b0e2e52-7b50-435e-9bf2-804d27f3855b tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.faf59bb2-5311-441e-83fc-3690a8880ae9 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:03:39 devstack sudo[111041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.faf59bb2-5311-441e-83fc-3690a8880ae9 1G Jun 24 10:03:39 devstack sudo[111041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:03:39 devstack sudo[111036]: pam_unix(sudo:session): session closed for user root Jun 24 10:03:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0b0dad69-9a27-450d-9789-abd2df202ddd tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ecbb6617-bced-4bba-b37b-c83d7e0c04e4" returned: 0 in 0.811s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:03:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0b0dad69-9a27-450d-9789-abd2df202ddd tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ecbb6617-bced-4bba-b37b-c83d7e0c04e4 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:03:39 devstack sudo[111047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ecbb6617-bced-4bba-b37b-c83d7e0c04e4 Jun 24 10:03:39 devstack sudo[111047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:03:40 devstack sudo[111041]: pam_unix(sudo:session): session closed for user root Jun 24 10:03:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2b0e2e52-7b50-435e-9bf2-804d27f3855b tempest-TestStampPattern-2058151550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.faf59bb2-5311-441e-83fc-3690a8880ae9 1G" returned: 0 in 0.819s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:03:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2b0e2e52-7b50-435e-9bf2-804d27f3855b tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.faf59bb2-5311-441e-83fc-3690a8880ae9 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:03:40 devstack sudo[111053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.faf59bb2-5311-441e-83fc-3690a8880ae9 Jun 24 10:03:40 devstack sudo[111053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:03:40 devstack sudo[111047]: pam_unix(sudo:session): session closed for user root Jun 24 10:03:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0b0dad69-9a27-450d-9789-abd2df202ddd tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ecbb6617-bced-4bba-b37b-c83d7e0c04e4" returned: 0 in 0.720s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:03:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0b0dad69-9a27-450d-9789-abd2df202ddd tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "cinder-quobyte-ecbb6617-bced-4bba-b37b-c83d7e0c04e4" released by "delete_volume" :: held 1.586s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:03:40 devstack cinder-volume[93447]: WARNING cinder.quota [None req-0b0dad69-9a27-450d-9789-abd2df202ddd tempest-TestInstancesWithCinderVolumes-743389812 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-43531071-1805267970 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-43531071-1805267970, it is now deprecated. Please use the default quota class for default quota. Jun 24 10:03:40 devstack cinder-volume[93447]: WARNING cinder.quota [None req-0b0dad69-9a27-450d-9789-abd2df202ddd tempest-TestInstancesWithCinderVolumes-743389812 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-43531071-1805267970 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-43531071-1805267970, it is now deprecated. Please use the default quota class for default quota. Jun 24 10:03:40 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-0b0dad69-9a27-450d-9789-abd2df202ddd tempest-TestInstancesWithCinderVolumes-743389812 None] Created reservations ['86245da8-ddc0-4750-90c0-1b3ca317fd8d', 'edce0199-3fbd-4b2f-8be8-3469413d52be', '420bf08a-9577-435f-8357-97b448188d2d', '6843c90f-49c5-4b23-8961-83b135d546ae'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:03:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0b0dad69-9a27-450d-9789-abd2df202ddd tempest-TestInstancesWithCinderVolumes-743389812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:03:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0b0dad69-9a27-450d-9789-abd2df202ddd tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:03:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0b0dad69-9a27-450d-9789-abd2df202ddd tempest-TestInstancesWithCinderVolumes-743389812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:03:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0b0dad69-9a27-450d-9789-abd2df202ddd tempest-TestInstancesWithCinderVolumes-743389812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:03:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0b0dad69-9a27-450d-9789-abd2df202ddd tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:03:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0b0dad69-9a27-450d-9789-abd2df202ddd tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:03:40 devstack sudo[111058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:03:40 devstack sudo[111058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:03:41 devstack sudo[111053]: pam_unix(sudo:session): session closed for user root Jun 24 10:03:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2b0e2e52-7b50-435e-9bf2-804d27f3855b tempest-TestStampPattern-2058151550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.faf59bb2-5311-441e-83fc-3690a8880ae9" returned: 0 in 0.816s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:03:41 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-2b0e2e52-7b50-435e-9bf2-804d27f3855b tempest-TestStampPattern-2058151550 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.faf59bb2-5311-441e-83fc-3690a8880ae9 is being set with open permissions: ugo+rw Jun 24 10:03:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2b0e2e52-7b50-435e-9bf2-804d27f3855b tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.faf59bb2-5311-441e-83fc-3690a8880ae9 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:03:41 devstack sudo[111067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.faf59bb2-5311-441e-83fc-3690a8880ae9 Jun 24 10:03:41 devstack sudo[111067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:03:41 devstack sudo[111058]: pam_unix(sudo:session): session closed for user root Jun 24 10:03:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0b0dad69-9a27-450d-9789-abd2df202ddd tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.676s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:03:41 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-0b0dad69-9a27-450d-9789-abd2df202ddd tempest-TestInstancesWithCinderVolumes-743389812 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:03:41 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-0b0dad69-9a27-450d-9789-abd2df202ddd tempest-TestInstancesWithCinderVolumes-743389812 None] Deleted volume successfully. Jun 24 10:03:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0b0dad69-9a27-450d-9789-abd2df202ddd tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "cinder-ecbb6617-bced-4bba-b37b-c83d7e0c04e4-delete_volume" released by "delete_volume" :: held 2.521s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:03:41 devstack sudo[111067]: pam_unix(sudo:session): session closed for user root Jun 24 10:03:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2b0e2e52-7b50-435e-9bf2-804d27f3855b tempest-TestStampPattern-2058151550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.faf59bb2-5311-441e-83fc-3690a8880ae9" returned: 0 in 0.687s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:03:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2b0e2e52-7b50-435e-9bf2-804d27f3855b tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:03:41 devstack sudo[111085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.info Jun 24 10:03:41 devstack sudo[111085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:03:42 devstack sudo[111085]: pam_unix(sudo:session): session closed for user root Jun 24 10:03:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2b0e2e52-7b50-435e-9bf2-804d27f3855b tempest-TestStampPattern-2058151550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.info" returned: 0 in 0.665s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:03:42 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-2b0e2e52-7b50-435e-9bf2-804d27f3855b tempest-TestStampPattern-2058151550 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.info is being set with open permissions: ugo+rw Jun 24 10:03:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2b0e2e52-7b50-435e-9bf2-804d27f3855b tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:03:42 devstack sudo[111089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.info Jun 24 10:03:42 devstack sudo[111089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:03:43 devstack sudo[111089]: pam_unix(sudo:session): session closed for user root Jun 24 10:03:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2b0e2e52-7b50-435e-9bf2-804d27f3855b tempest-TestStampPattern-2058151550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.info" returned: 0 in 0.640s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:03:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2b0e2e52-7b50-435e-9bf2-804d27f3855b tempest-TestStampPattern-2058151550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.480s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:03:43 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-2b0e2e52-7b50-435e-9bf2-804d27f3855b tempest-TestStampPattern-2058151550 None] Create snapshot completed successfully Jun 24 10:03:43 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-92461dbd-0cad-419b-a160-e6fd5427999b req-79d233c9-9512-4fd5-ba00-7f23449ee04f tempest-TestInstancesWithCinderVolumes-743389812 None] Terminate volume connection completed successfully. Jun 24 10:03:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-92461dbd-0cad-419b-a160-e6fd5427999b req-79d233c9-9512-4fd5-ba00-7f23449ee04f tempest-TestInstancesWithCinderVolumes-743389812 None] Deleting attachment 85431f07-9b10-45b8-b671-84b6019135b8. {{(pid=93447) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 10:03:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-96d8997b-0214-4799-bd84-f6fa765ae85d tempest-TestInstancesWithCinderVolumes-743389812 None] Acquiring lock "cinder-adba2c84-5085-46ba-b889-0c65188f89cd-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:03:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-96d8997b-0214-4799-bd84-f6fa765ae85d tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "cinder-adba2c84-5085-46ba-b889-0c65188f89cd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:03:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-96d8997b-0214-4799-bd84-f6fa765ae85d tempest-TestInstancesWithCinderVolumes-743389812 None] Acquiring lock "cinder-quobyte-adba2c84-5085-46ba-b889-0c65188f89cd" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:03:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-96d8997b-0214-4799-bd84-f6fa765ae85d tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "cinder-quobyte-adba2c84-5085-46ba-b889-0c65188f89cd" acquired by "delete_volume" :: waited 0.018s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:03:45 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcef6c3-2696-4ceb-8dbc-d53697e59e2b]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:03:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-96d8997b-0214-4799-bd84-f6fa765ae85d tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adba2c84-5085-46ba-b889-0c65188f89cd {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:03:45 devstack sudo[111106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adba2c84-5085-46ba-b889-0c65188f89cd Jun 24 10:03:45 devstack sudo[111106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:03:46 devstack sudo[111106]: pam_unix(sudo:session): session closed for user root Jun 24 10:03:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-96d8997b-0214-4799-bd84-f6fa765ae85d tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adba2c84-5085-46ba-b889-0c65188f89cd" returned: 0 in 0.823s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:03:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-96d8997b-0214-4799-bd84-f6fa765ae85d tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adba2c84-5085-46ba-b889-0c65188f89cd {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:03:46 devstack sudo[111111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adba2c84-5085-46ba-b889-0c65188f89cd Jun 24 10:03:46 devstack sudo[111111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:03:47 devstack sudo[111111]: pam_unix(sudo:session): session closed for user root Jun 24 10:03:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-96d8997b-0214-4799-bd84-f6fa765ae85d tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adba2c84-5085-46ba-b889-0c65188f89cd" returned: 0 in 0.772s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:03:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-96d8997b-0214-4799-bd84-f6fa765ae85d tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "cinder-quobyte-adba2c84-5085-46ba-b889-0c65188f89cd" released by "delete_volume" :: held 1.642s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:03:47 devstack cinder-volume[93447]: WARNING cinder.quota [None req-96d8997b-0214-4799-bd84-f6fa765ae85d tempest-TestInstancesWithCinderVolumes-743389812 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1159127784-1625447686 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1159127784-1625447686, it is now deprecated. Please use the default quota class for default quota. Jun 24 10:03:47 devstack cinder-volume[93447]: WARNING cinder.quota [None req-96d8997b-0214-4799-bd84-f6fa765ae85d tempest-TestInstancesWithCinderVolumes-743389812 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1159127784-1625447686 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1159127784-1625447686, it is now deprecated. Please use the default quota class for default quota. Jun 24 10:03:47 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-96d8997b-0214-4799-bd84-f6fa765ae85d tempest-TestInstancesWithCinderVolumes-743389812 None] Created reservations ['068c5174-3a0c-4625-8922-6d9ddc3ee243', 'eb00240f-b69d-49bb-a1aa-6e30f2784736', 'e012e837-616e-458a-90bb-ca60d2c7762d', 'e28cdc7a-aaed-4834-af88-56cff7a5495c'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:03:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-96d8997b-0214-4799-bd84-f6fa765ae85d tempest-TestInstancesWithCinderVolumes-743389812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:03:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-96d8997b-0214-4799-bd84-f6fa765ae85d tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:03:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-96d8997b-0214-4799-bd84-f6fa765ae85d tempest-TestInstancesWithCinderVolumes-743389812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:03:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-96d8997b-0214-4799-bd84-f6fa765ae85d tempest-TestInstancesWithCinderVolumes-743389812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:03:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-96d8997b-0214-4799-bd84-f6fa765ae85d tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:03:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-96d8997b-0214-4799-bd84-f6fa765ae85d tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:03:47 devstack sudo[111115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:03:47 devstack sudo[111115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:03:48 devstack sudo[111115]: pam_unix(sudo:session): session closed for user root Jun 24 10:03:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-96d8997b-0214-4799-bd84-f6fa765ae85d tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.762s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:03:48 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-96d8997b-0214-4799-bd84-f6fa765ae85d tempest-TestInstancesWithCinderVolumes-743389812 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:03:48 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-96d8997b-0214-4799-bd84-f6fa765ae85d tempest-TestInstancesWithCinderVolumes-743389812 None] Deleted volume successfully. Jun 24 10:03:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-96d8997b-0214-4799-bd84-f6fa765ae85d tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "cinder-adba2c84-5085-46ba-b889-0c65188f89cd-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:03:52 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-4b13d479-52fc-4795-b168-4baccf205ae2 req-d376cc73-16a0-4a83-b947-ece60d155694 tempest-TestInstancesWithCinderVolumes-743389812 None] Terminate volume connection completed successfully. Jun 24 10:03:52 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-4b13d479-52fc-4795-b168-4baccf205ae2 req-d376cc73-16a0-4a83-b947-ece60d155694 tempest-TestInstancesWithCinderVolumes-743389812 None] Deleting attachment 34b63eaf-abe2-4fec-af42-b2878769568e. {{(pid=93447) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Flow 'volume_create_manager' (554513f1-dda5-46c6-a561-bb37b06c8cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5cdeda-e7d2-49dc-a124-afb052c801b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5cdeda-e7d2-49dc-a124-afb052c801b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-426613406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d075f0eae484a72be1056fb553758c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=faf59bb2-5311-441e-83fc-3690a8880ae9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:03:55Z,use_quota=True,user_id='6a0c6fa35f824f219a10722a31868a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffda0aa-91b8-4abf-9174-f4f49f829633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffda0aa-91b8-4abf-9174-f4f49f829633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a426f68-a086-47ba-a99e-9f4a49138ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a426f68-a086-47ba-a99e-9f4a49138ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7', 'volume_name': 'volume-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7', 'volume_size': 1, 'snapshot_id': 'faf59bb2-5311-441e-83fc-3690a8880ae9'}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f540a1b1-51e0-4dfb-b158-0e2f5cf712ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f540a1b1-51e0-4dfb-b158-0e2f5cf712ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb7a466-3b26-4720-86b6-11963aaa1067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:03:54 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Volume 33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7', 'volume_size': 1, 'snapshot_id': 'faf59bb2-5311-441e-83fc-3690a8880ae9'} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Acquiring lock "cinder-quobyte-faf59bb2-5311-441e-83fc-3690a8880ae9-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7" by "_create_volume_from_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Lock "cinder-quobyte-faf59bb2-5311-441e-83fc-3690a8880ae9-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Creating volume 33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7 from snapshot faf59bb2-5311-441e-83fc-3690a8880ae9 {{(pid=93447) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Acquiring lock "cinder-quobyte-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7" by "_copy_volume_from_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Lock "cinder-quobyte-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] snapshot: faf59bb2-5311-441e-83fc-3690a8880ae9, volume: 33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7, {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d84802-a61b-4717-add0-72437eb7aec8]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:03:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.faf59bb2-5311-441e-83fc-3690a8880ae9 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:03:55 devstack sudo[111264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.faf59bb2-5311-441e-83fc-3690a8880ae9 Jun 24 10:03:55 devstack sudo[111264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:03:55 devstack sudo[111264]: pam_unix(sudo:session): session closed for user root Jun 24 10:03:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.faf59bb2-5311-441e-83fc-3690a8880ae9" returned: 0 in 0.801s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:03:55 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef61f34-7b2e-4313-8803-4e5e5af22834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:03:55 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 10:03:55 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Creating direct copy from snapshot {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 10:03:55 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[67659dec-4566-4ed8-981f-0462313f26d6]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:03:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:03:55 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] Acquiring lock "cinder-49381dd1-a992-44e2-ae34-1bd7770f6c6f-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:03:55 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "cinder-49381dd1-a992-44e2-ae34-1bd7770f6c6f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:03:55 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] Acquiring lock "cinder-quobyte-49381dd1-a992-44e2-ae34-1bd7770f6c6f" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:03:55 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "cinder-quobyte-49381dd1-a992-44e2-ae34-1bd7770f6c6f" acquired by "delete_volume" :: waited 0.016s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:03:55 devstack sudo[111273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 Jun 24 10:03:55 devstack sudo[111273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:03:55 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[153a1841-bfb8-4884-a55f-31bcbcc10d55]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:03:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:03:55 devstack sudo[111275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f Jun 24 10:03:55 devstack sudo[111275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:03:56 devstack sudo[111273]: pam_unix(sudo:session): session closed for user root Jun 24 10:03:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834" returned: 0 in 0.821s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:03:56 devstack cinder-volume[93447]: DEBUG cinder.utils [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Path /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7 not found in is_blk_device check {{(pid=93447) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 10:03:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:03:56 devstack sudo[111282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7 Jun 24 10:03:56 devstack sudo[111282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:03:56 devstack sudo[111275]: pam_unix(sudo:session): session closed for user root Jun 24 10:03:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f" returned: 0 in 0.793s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:03:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:03:56 devstack sudo[111284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f Jun 24 10:03:56 devstack sudo[111284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:03:57 devstack sudo[111284]: pam_unix(sudo:session): session closed for user root Jun 24 10:03:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f" returned: 1 in 0.812s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:03:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:03:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:03:57 devstack sudo[111299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f Jun 24 10:03:57 devstack sudo[111299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:03:58 devstack sudo[111299]: pam_unix(sudo:session): session closed for user root Jun 24 10:03:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-49381dd1-a992-44e2-ae34-1bd7770f6c6f" returned: 0 in 1.348s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:03:58 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "cinder-quobyte-49381dd1-a992-44e2-ae34-1bd7770f6c6f" released by "delete_volume" :: held 3.035s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:03:58 devstack cinder-volume[93447]: WARNING cinder.quota [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-81705056-1706906402 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-81705056-1706906402, it is now deprecated. Please use the default quota class for default quota. Jun 24 10:03:58 devstack cinder-volume[93447]: WARNING cinder.quota [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-81705056-1706906402 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-81705056-1706906402, it is now deprecated. Please use the default quota class for default quota. Jun 24 10:03:58 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] Created reservations ['52d30693-9ad9-4b42-91a7-a1b2cc827c0a', '693be081-3927-49f8-97f7-d51926fa12ec', '0fae4544-184c-406d-8e7e-db6a1da3d4e2', '4cc088e6-19a3-4758-949b-f49dc2661511'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:03:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:03:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:03:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:03:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:03:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:03:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:03:59 devstack sudo[111303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:03:59 devstack sudo[111303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:04:01 devstack sudo[111303]: pam_unix(sudo:session): session closed for user root Jun 24 10:04:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 2.006s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:04:01 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:04:01 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] Deleted volume successfully. Jun 24 10:04:01 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1c9bde02-b1b4-45f1-8c7c-ef76ffb40fbb tempest-TestInstancesWithCinderVolumes-743389812 None] Lock "cinder-49381dd1-a992-44e2-ae34-1bd7770f6c6f-delete_volume" released by "delete_volume" :: held 5.411s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:04:02 devstack sudo[111282]: pam_unix(sudo:session): session closed for user root Jun 24 10:04:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7" returned: 0 in 5.944s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:04:02 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad32dad-e7c9-4ec9-b25b-5c37ffa62800]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:04:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:04:02 devstack sudo[111309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 Jun 24 10:04:02 devstack sudo[111309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:04:03 devstack sudo[111309]: pam_unix(sudo:session): session closed for user root Jun 24 10:04:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834" returned: 0 in 1.390s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:04:03 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7 {{(pid=93447) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 10:04:03 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Converted 1024.00 MB image at 172.23 MB/s Jun 24 10:04:03 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7 is being set with open permissions: ugo+rw Jun 24 10:04:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:04:03 devstack sudo[111321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7 Jun 24 10:04:03 devstack sudo[111321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:04:04 devstack sudo[111321]: pam_unix(sudo:session): session closed for user root Jun 24 10:04:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7" returned: 0 in 0.779s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:04:04 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Lock "cinder-quobyte-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7" released by "_copy_volume_from_snapshot" :: held 9.844s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:04:04 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Lock "cinder-quobyte-faf59bb2-5311-441e-83fc-3690a8880ae9-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7" released by "_create_volume_from_snapshot" :: held 9.872s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:04:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.886s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:04:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb7a466-3b26-4720-86b6-11963aaa1067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7', 'volume_size': 1, 'snapshot_id': 'faf59bb2-5311-441e-83fc-3690a8880ae9'}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:04:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (766bef3b-7a63-4d2b-86b5-da96c846912a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:04:04 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Volume volume-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7 (33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7): created successfully Jun 24 10:04:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (766bef3b-7a63-4d2b-86b5-da96c846912a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:04:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Flow 'volume_create_manager' (554513f1-dda5-46c6-a561-bb37b06c8cb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:04:04 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-a9411122-275d-46f5-90ac-472c7029d7e2 tempest-TestStampPattern-2058151550 None] Created volume successfully. Jun 24 10:04:14 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=38,cinder:UPDATE=35,cinder:INSERT=9,cinder:DELETE=1 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 10:04:14 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=45,cinder:UPDATE=29,cinder:INSERT=4,cinder:DELETE=4 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 10:04:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 10:04:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:04:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:04:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:04:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:04:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:04:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:04:25 devstack sudo[111434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:04:25 devstack sudo[111434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:04:25 devstack sudo[111434]: pam_unix(sudo:session): session closed for user root Jun 24 10:04:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.681s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:04:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:04:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 10:04:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 28 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 10:04:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 10:04:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-9f23d537-a7fe-4b58-bf5f-a2ceec6d7b90 req-d13a6dc3-15f5-4ec1-ac41-9f136884c0c4 tempest-TestStampPattern-2058151550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:04:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-9f23d537-a7fe-4b58-bf5f-a2ceec6d7b90 req-d13a6dc3-15f5-4ec1-ac41-9f136884c0c4 tempest-TestStampPattern-2058151550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:04:41 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f5ec21-2830-4ce9-8061-87a06f9daefa]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:04:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-9f23d537-a7fe-4b58-bf5f-a2ceec6d7b90 req-d13a6dc3-15f5-4ec1-ac41-9f136884c0c4 tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:04:41 devstack sudo[111492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7 Jun 24 10:04:41 devstack sudo[111492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:04:41 devstack sudo[111492]: pam_unix(sudo:session): session closed for user root Jun 24 10:04:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-9f23d537-a7fe-4b58-bf5f-a2ceec6d7b90 req-d13a6dc3-15f5-4ec1-ac41-9f136884c0c4 tempest-TestStampPattern-2058151550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7" returned: 0 in 0.810s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:04:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-9f23d537-a7fe-4b58-bf5f-a2ceec6d7b90 req-d13a6dc3-15f5-4ec1-ac41-9f136884c0c4 tempest-TestStampPattern-2058151550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.830s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:04:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-9f23d537-a7fe-4b58-bf5f-a2ceec6d7b90 req-d13a6dc3-15f5-4ec1-ac41-9f136884c0c4 tempest-TestStampPattern-2058151550 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb', 'name': 'volume-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c53eb0a2-d495-4c3b-ad46-d70af38385d9', 'enforce_multipath': True} {{(pid=93447) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 10:04:41 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-9f23d537-a7fe-4b58-bf5f-a2ceec6d7b90 req-d13a6dc3-15f5-4ec1-ac41-9f136884c0c4 tempest-TestStampPattern-2058151550 None] attachment_update completed successfully. Jun 24 10:04:48 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-8daac018-5a16-426a-9790-a20e23ffe8e2 req-63bbe72f-2639-4a10-9d22-eab540d7cb2a tempest-TestStampPattern-2058151550 None] Terminate volume connection completed successfully. Jun 24 10:04:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-8daac018-5a16-426a-9790-a20e23ffe8e2 req-63bbe72f-2639-4a10-9d22-eab540d7cb2a tempest-TestStampPattern-2058151550 None] Deleting attachment c53eb0a2-d495-4c3b-ad46-d70af38385d9. {{(pid=93447) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 10:04:51 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 10:04:53 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:04:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Flow 'volume_create_manager' (4cd4eb0b-0e83-421c-a4f9-06e6eb70e266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:04:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ca4c48-1f74-4587-87ba-6cd6c003c20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:04:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ca4c48-1f74-4587-87ba-6cd6c003c20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1603438592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e1637b-44dc-4d92-a98e-a84b12d16c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f22db61e9c44f7a9cc8fb240e9a4c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:04:53Z,use_quota=True,user_id='1b7a64a92f3041b182ca8b62dba88df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:04:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b094648-31e9-4294-81ee-da8f93ea8a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:04:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b094648-31e9-4294-81ee-da8f93ea8a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:04:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1639d5-b8d7-4643-b965-e48b21ae0ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:04:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1639d5-b8d7-4643-b965-e48b21ae0ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2e1637b-44dc-4d92-a98e-a84b12d16c40', 'volume_name': 'volume-f2e1637b-44dc-4d92-a98e-a84b12d16c40', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:04:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cccd4542-a999-448c-b89b-15e774b8be31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:04:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cccd4542-a999-448c-b89b-15e774b8be31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:04:53 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24867484-51fd-4795-a8a8-6449b4c4b54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:04:53 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Volume f2e1637b-44dc-4d92-a98e-a84b12d16c40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2e1637b-44dc-4d92-a98e-a84b12d16c40', 'volume_size': 1} Jun 24 10:04:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:04:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:04:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1603438592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e1637b-44dc-4d92-a98e-a84b12d16c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f22db61e9c44f7a9cc8fb240e9a4c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:04:53Z,use_quota=True,user_id='1b7a64a92f3041b182ca8b62dba88df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:04:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Creating volume f2e1637b-44dc-4d92-a98e-a84b12d16c40 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:04:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:04:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:04:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:04:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:04:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:04:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:04:53 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:04:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f2e1637b-44dc-4d92-a98e-a84b12d16c40 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:04:53 devstack sudo[112101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f2e1637b-44dc-4d92-a98e-a84b12d16c40 1073741824 Jun 24 10:04:53 devstack sudo[112101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:04:54 devstack sudo[112101]: pam_unix(sudo:session): session closed for user root Jun 24 10:04:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f2e1637b-44dc-4d92-a98e-a84b12d16c40 1073741824" returned: 0 in 0.897s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:04:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f2e1637b-44dc-4d92-a98e-a84b12d16c40 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:04:54 devstack sudo[112110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f2e1637b-44dc-4d92-a98e-a84b12d16c40 Jun 24 10:04:54 devstack sudo[112110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:04:55 devstack sudo[112110]: pam_unix(sudo:session): session closed for user root Jun 24 10:04:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f2e1637b-44dc-4d92-a98e-a84b12d16c40" returned: 0 in 0.732s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:04:55 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:04:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:04:55 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24867484-51fd-4795-a8a8-6449b4c4b54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2e1637b-44dc-4d92-a98e-a84b12d16c40', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:04:55 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b3cd5a-0db5-46fa-8273-0a029e5115e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:04:55 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Volume volume-f2e1637b-44dc-4d92-a98e-a84b12d16c40 (f2e1637b-44dc-4d92-a98e-a84b12d16c40): created successfully Jun 24 10:04:55 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b3cd5a-0db5-46fa-8273-0a029e5115e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:04:55 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Flow 'volume_create_manager' (4cd4eb0b-0e83-421c-a4f9-06e6eb70e266) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:04:55 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-c02710c9-c00e-46a9-acf4-bb502c428205 tempest-TestMinimumBasicScenario-32333345 None] Created volume successfully. Jun 24 10:04:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-d14acee9-6a34-459f-b725-d769926d22d4 req-357f0778-1491-4846-bd3f-add1b896aa92 tempest-TestMinimumBasicScenario-32333345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:04:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-d14acee9-6a34-459f-b725-d769926d22d4 req-357f0778-1491-4846-bd3f-add1b896aa92 tempest-TestMinimumBasicScenario-32333345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:04:58 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e45bbb-fc10-4759-b067-f39e85d03feb]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:04:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-d14acee9-6a34-459f-b725-d769926d22d4 req-357f0778-1491-4846-bd3f-add1b896aa92 tempest-TestMinimumBasicScenario-32333345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f2e1637b-44dc-4d92-a98e-a84b12d16c40 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:04:58 devstack sudo[112125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f2e1637b-44dc-4d92-a98e-a84b12d16c40 Jun 24 10:04:58 devstack sudo[112125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:04:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-048dd43d-2804-49fb-ba87-0cae7dfd573e tempest-TestStampPattern-2058151550 None] Acquiring lock "cinder-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:04:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-048dd43d-2804-49fb-ba87-0cae7dfd573e tempest-TestStampPattern-2058151550 None] Lock "cinder-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:04:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-048dd43d-2804-49fb-ba87-0cae7dfd573e tempest-TestStampPattern-2058151550 None] Acquiring lock "cinder-quobyte-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:04:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-048dd43d-2804-49fb-ba87-0cae7dfd573e tempest-TestStampPattern-2058151550 None] Lock "cinder-quobyte-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7" acquired by "delete_volume" :: waited 0.032s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:04:59 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d137b835-f97c-48bc-a777-7326fcefa0aa]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:04:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-048dd43d-2804-49fb-ba87-0cae7dfd573e tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:04:59 devstack sudo[112125]: pam_unix(sudo:session): session closed for user root Jun 24 10:04:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-d14acee9-6a34-459f-b725-d769926d22d4 req-357f0778-1491-4846-bd3f-add1b896aa92 tempest-TestMinimumBasicScenario-32333345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f2e1637b-44dc-4d92-a98e-a84b12d16c40" returned: 0 in 0.866s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:04:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-d14acee9-6a34-459f-b725-d769926d22d4 req-357f0778-1491-4846-bd3f-add1b896aa92 tempest-TestMinimumBasicScenario-32333345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.884s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:04:59 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-d14acee9-6a34-459f-b725-d769926d22d4 req-357f0778-1491-4846-bd3f-add1b896aa92 tempest-TestMinimumBasicScenario-32333345 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb', 'name': 'volume-f2e1637b-44dc-4d92-a98e-a84b12d16c40', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0ace6e7-9ddb-4685-a250-0269ee822226', 'enforce_multipath': True} {{(pid=93447) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 10:04:59 devstack sudo[112130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7 Jun 24 10:04:59 devstack sudo[112130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:04:59 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-d14acee9-6a34-459f-b725-d769926d22d4 req-357f0778-1491-4846-bd3f-add1b896aa92 tempest-TestMinimumBasicScenario-32333345 None] attachment_update completed successfully. Jun 24 10:05:00 devstack sudo[112130]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-048dd43d-2804-49fb-ba87-0cae7dfd573e tempest-TestStampPattern-2058151550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7" returned: 0 in 0.799s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-048dd43d-2804-49fb-ba87-0cae7dfd573e tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:00 devstack sudo[112158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7 Jun 24 10:05:00 devstack sudo[112158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:01 devstack sudo[112158]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-048dd43d-2804-49fb-ba87-0cae7dfd573e tempest-TestStampPattern-2058151550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7" returned: 0 in 0.707s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:01 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-048dd43d-2804-49fb-ba87-0cae7dfd573e tempest-TestStampPattern-2058151550 None] Lock "cinder-quobyte-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7" released by "delete_volume" :: held 1.564s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:05:01 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-048dd43d-2804-49fb-ba87-0cae7dfd573e tempest-TestStampPattern-2058151550 None] Created reservations ['e06c0680-ef2d-4b84-9e51-289fb2a2a63e', '4cfdd579-f796-4bee-a410-5251a70e75eb', '230cbaac-01e2-4241-a955-35dc3c02de13', 'e67701f6-354a-4635-b2eb-e250b5b1b519'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:05:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-048dd43d-2804-49fb-ba87-0cae7dfd573e tempest-TestStampPattern-2058151550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:05:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-048dd43d-2804-49fb-ba87-0cae7dfd573e tempest-TestStampPattern-2058151550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:05:01 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-048dd43d-2804-49fb-ba87-0cae7dfd573e tempest-TestStampPattern-2058151550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:05:01 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-048dd43d-2804-49fb-ba87-0cae7dfd573e tempest-TestStampPattern-2058151550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:05:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-048dd43d-2804-49fb-ba87-0cae7dfd573e tempest-TestStampPattern-2058151550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:05:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-048dd43d-2804-49fb-ba87-0cae7dfd573e tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:01 devstack sudo[112523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:05:01 devstack sudo[112523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:01 devstack sudo[112523]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-048dd43d-2804-49fb-ba87-0cae7dfd573e tempest-TestStampPattern-2058151550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.673s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:01 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-048dd43d-2804-49fb-ba87-0cae7dfd573e tempest-TestStampPattern-2058151550 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:05:01 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-048dd43d-2804-49fb-ba87-0cae7dfd573e tempest-TestStampPattern-2058151550 None] Deleted volume successfully. Jun 24 10:05:01 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-048dd43d-2804-49fb-ba87-0cae7dfd573e tempest-TestStampPattern-2058151550 None] Lock "cinder-33bd7d7a-754c-4ab0-bcbf-7cf79a20c7e7-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:05:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-702f853c-da91-42f2-baea-62ef54b9b74e tempest-TestStampPattern-2058151550 None] Acquiring lock "cinder-faf59bb2-5311-441e-83fc-3690a8880ae9-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:05:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-702f853c-da91-42f2-baea-62ef54b9b74e tempest-TestStampPattern-2058151550 None] Lock "cinder-faf59bb2-5311-441e-83fc-3690a8880ae9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:05:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-702f853c-da91-42f2-baea-62ef54b9b74e tempest-TestStampPattern-2058151550 None] Acquiring lock "cinder-quobyte-8ef61f34-7b2e-4313-8803-4e5e5af22834" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:05:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-702f853c-da91-42f2-baea-62ef54b9b74e tempest-TestStampPattern-2058151550 None] Lock "cinder-quobyte-8ef61f34-7b2e-4313-8803-4e5e5af22834" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:05:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-702f853c-da91-42f2-baea-62ef54b9b74e tempest-TestStampPattern-2058151550 None] Acquiring lock "cinder-quobyte-faf59bb2-5311-441e-83fc-3690a8880ae9" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:05:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-702f853c-da91-42f2-baea-62ef54b9b74e tempest-TestStampPattern-2058151550 None] Lock "cinder-quobyte-faf59bb2-5311-441e-83fc-3690a8880ae9" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:05:02 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-702f853c-da91-42f2-baea-62ef54b9b74e tempest-TestStampPattern-2058151550 None] Deleting offline snapshot faf59bb2-5311-441e-83fc-3690a8880ae9 of volume 8ef61f34-7b2e-4313-8803-4e5e5af22834 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 10:05:02 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-702f853c-da91-42f2-baea-62ef54b9b74e tempest-TestStampPattern-2058151550 None] snapshot_file for this snap is: volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.faf59bb2-5311-441e-83fc-3690a8880ae9 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 10:05:02 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[278949d8-29dc-4295-92af-3f01b85f81a9]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:05:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-702f853c-da91-42f2-baea-62ef54b9b74e tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.faf59bb2-5311-441e-83fc-3690a8880ae9 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:02 devstack sudo[112531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.faf59bb2-5311-441e-83fc-3690a8880ae9 Jun 24 10:05:02 devstack sudo[112531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:02 devstack sudo[112531]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-702f853c-da91-42f2-baea-62ef54b9b74e tempest-TestStampPattern-2058151550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.faf59bb2-5311-441e-83fc-3690a8880ae9" returned: 0 in 0.806s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:02 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-702f853c-da91-42f2-baea-62ef54b9b74e tempest-TestStampPattern-2058151550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef61f34-7b2e-4313-8803-4e5e5af22834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:05:02 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[99360c5f-21c1-4718-ac00-a6dbc7fb1af7]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:05:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-702f853c-da91-42f2-baea-62ef54b9b74e tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:03 devstack sudo[112564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 Jun 24 10:05:03 devstack sudo[112564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:03 devstack sudo[112564]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-702f853c-da91-42f2-baea-62ef54b9b74e tempest-TestStampPattern-2058151550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834" returned: 0 in 0.813s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-702f853c-da91-42f2-baea-62ef54b9b74e tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.faf59bb2-5311-441e-83fc-3690a8880ae9 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:03 devstack sudo[112575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.faf59bb2-5311-441e-83fc-3690a8880ae9 Jun 24 10:05:03 devstack sudo[112575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:04 devstack sudo[112575]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-702f853c-da91-42f2-baea-62ef54b9b74e tempest-TestStampPattern-2058151550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.faf59bb2-5311-441e-83fc-3690a8880ae9" returned: 0 in 0.760s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-702f853c-da91-42f2-baea-62ef54b9b74e tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.faf59bb2-5311-441e-83fc-3690a8880ae9 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:04 devstack sudo[112580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.faf59bb2-5311-441e-83fc-3690a8880ae9 Jun 24 10:05:04 devstack sudo[112580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:05 devstack sudo[112580]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-702f853c-da91-42f2-baea-62ef54b9b74e tempest-TestStampPattern-2058151550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834.faf59bb2-5311-441e-83fc-3690a8880ae9" returned: 0 in 0.682s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-702f853c-da91-42f2-baea-62ef54b9b74e tempest-TestStampPattern-2058151550 None] Lock "cinder-quobyte-faf59bb2-5311-441e-83fc-3690a8880ae9" released by "_delete_snapshot" :: held 3.179s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:05:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-702f853c-da91-42f2-baea-62ef54b9b74e tempest-TestStampPattern-2058151550 None] Lock "cinder-quobyte-8ef61f34-7b2e-4313-8803-4e5e5af22834" released by "delete_snapshot" :: held 3.199s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:05:05 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-702f853c-da91-42f2-baea-62ef54b9b74e tempest-TestStampPattern-2058151550 None] Created reservations ['462b6bab-ff7e-4078-a9b7-c4d34978221c', '76cbb29d-b02e-4253-9911-3a644e0576f1', 'e4020a2b-2409-4c3a-9b7e-31f5b51b52d3', '0517b4c0-0f44-45bf-b822-692bf29121a6'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:05:05 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-702f853c-da91-42f2-baea-62ef54b9b74e tempest-TestStampPattern-2058151550 None] Delete snapshot completed successfully. Jun 24 10:05:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-702f853c-da91-42f2-baea-62ef54b9b74e tempest-TestStampPattern-2058151550 None] Lock "cinder-faf59bb2-5311-441e-83fc-3690a8880ae9-delete_snapshot" released by "delete_snapshot" :: held 3.338s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:05:13 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-50e9f6d8-6270-4351-b0c9-43c0e5e3dae6 tempest-TestStampPattern-2058151550 None] Acquiring lock "cinder-8ef61f34-7b2e-4313-8803-4e5e5af22834-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:05:13 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-50e9f6d8-6270-4351-b0c9-43c0e5e3dae6 tempest-TestStampPattern-2058151550 None] Lock "cinder-8ef61f34-7b2e-4313-8803-4e5e5af22834-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:05:13 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-50e9f6d8-6270-4351-b0c9-43c0e5e3dae6 tempest-TestStampPattern-2058151550 None] Acquiring lock "cinder-quobyte-8ef61f34-7b2e-4313-8803-4e5e5af22834" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:05:13 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-50e9f6d8-6270-4351-b0c9-43c0e5e3dae6 tempest-TestStampPattern-2058151550 None] Lock "cinder-quobyte-8ef61f34-7b2e-4313-8803-4e5e5af22834" acquired by "delete_volume" :: waited 0.014s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:05:13 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9571af78-bc61-408b-9e9d-928f1bdc2d90]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:05:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-50e9f6d8-6270-4351-b0c9-43c0e5e3dae6 tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:14 devstack sudo[112632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 Jun 24 10:05:14 devstack sudo[112632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:14 devstack sudo[112632]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-50e9f6d8-6270-4351-b0c9-43c0e5e3dae6 tempest-TestStampPattern-2058151550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834" returned: 0 in 0.758s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-50e9f6d8-6270-4351-b0c9-43c0e5e3dae6 tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:14 devstack sudo[112637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834 Jun 24 10:05:14 devstack sudo[112637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:15 devstack sudo[112637]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-50e9f6d8-6270-4351-b0c9-43c0e5e3dae6 tempest-TestStampPattern-2058151550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8ef61f34-7b2e-4313-8803-4e5e5af22834" returned: 0 in 0.658s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:15 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-50e9f6d8-6270-4351-b0c9-43c0e5e3dae6 tempest-TestStampPattern-2058151550 None] Lock "cinder-quobyte-8ef61f34-7b2e-4313-8803-4e5e5af22834" released by "delete_volume" :: held 1.474s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:05:15 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-50e9f6d8-6270-4351-b0c9-43c0e5e3dae6 tempest-TestStampPattern-2058151550 None] Created reservations ['4f2e125d-cf4d-413b-9359-dd709ae997d6', '76b90ca3-95ec-41dc-b968-73562711b091', '4fd9d9a4-6ee9-48a5-b51e-505b5fd20a7c', '6b464607-4c28-4061-b28d-544ea0c057ae'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:05:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-50e9f6d8-6270-4351-b0c9-43c0e5e3dae6 tempest-TestStampPattern-2058151550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:05:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-50e9f6d8-6270-4351-b0c9-43c0e5e3dae6 tempest-TestStampPattern-2058151550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:05:15 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-50e9f6d8-6270-4351-b0c9-43c0e5e3dae6 tempest-TestStampPattern-2058151550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:05:15 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-50e9f6d8-6270-4351-b0c9-43c0e5e3dae6 tempest-TestStampPattern-2058151550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:05:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-50e9f6d8-6270-4351-b0c9-43c0e5e3dae6 tempest-TestStampPattern-2058151550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:05:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-50e9f6d8-6270-4351-b0c9-43c0e5e3dae6 tempest-TestStampPattern-2058151550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:15 devstack sudo[112640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:05:15 devstack sudo[112640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:16 devstack sudo[112640]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-50e9f6d8-6270-4351-b0c9-43c0e5e3dae6 tempest-TestStampPattern-2058151550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.686s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:16 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-50e9f6d8-6270-4351-b0c9-43c0e5e3dae6 tempest-TestStampPattern-2058151550 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:05:16 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-50e9f6d8-6270-4351-b0c9-43c0e5e3dae6 tempest-TestStampPattern-2058151550 None] Deleted volume successfully. Jun 24 10:05:16 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-50e9f6d8-6270-4351-b0c9-43c0e5e3dae6 tempest-TestStampPattern-2058151550 None] Lock "cinder-8ef61f34-7b2e-4313-8803-4e5e5af22834-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:05:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 10:05:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:05:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:05:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:05:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:05:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:05:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:25 devstack sudo[112796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:05:25 devstack sudo[112796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:25 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=22,cinder:UPDATE=24,cinder:INSERT=6 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 10:05:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.734s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:05:25 devstack sudo[112796]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 10:05:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 28 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 10:05:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 10:05:26 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:UPDATE=31,cinder:SELECT=31,cinder:INSERT=7,cinder:DELETE=3 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Flow 'volume_create_manager' (d74b192c-d9a6-4230-a95f-c40aa496bbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec16c925-389c-45a8-b235-4d9112d854dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec16c925-389c-45a8-b235-4d9112d854dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1395762770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca646024-6b71-49e8-9c7d-39fe20fc0a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b21e13463746908f233034d08e0056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:05:28Z,use_quota=True,user_id='84f6e6283cd24193b8d1c6040c835e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cfae41d-7f0f-4446-bed6-e89de895843d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cfae41d-7f0f-4446-bed6-e89de895843d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa80cf8a-5994-4c57-ad2b-0f675db3cd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa80cf8a-5994-4c57-ad2b-0f675db3cd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca646024-6b71-49e8-9c7d-39fe20fc0a3b', 'volume_name': 'volume-ca646024-6b71-49e8-9c7d-39fe20fc0a3b', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af154b58-554f-4e98-9762-09953b2bd777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af154b58-554f-4e98-9762-09953b2bd777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ceacbc-4b05-47da-ad16-3c87fbef5f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:28 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Volume ca646024-6b71-49e8-9c7d-39fe20fc0a3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca646024-6b71-49e8-9c7d-39fe20fc0a3b', 'volume_size': 1} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1395762770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca646024-6b71-49e8-9c7d-39fe20fc0a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b21e13463746908f233034d08e0056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:05:28Z,use_quota=True,user_id='84f6e6283cd24193b8d1c6040c835e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Creating volume ca646024-6b71-49e8-9c7d-39fe20fc0a3b {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:05:28 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca646024-6b71-49e8-9c7d-39fe20fc0a3b 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:28 devstack sudo[112835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca646024-6b71-49e8-9c7d-39fe20fc0a3b 1073741824 Jun 24 10:05:28 devstack sudo[112835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Flow 'volume_create_manager' (20e4ff01-66ae-4791-9bba-85f1f09c5810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f58fdd4-89db-4e0f-bb15-576467e01d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f58fdd4-89db-4e0f-bb15-576467e01d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-352808403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e797bdb8-4928-4ffc-80d4-578d702f9126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b21e13463746908f233034d08e0056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:05:29Z,use_quota=True,user_id='84f6e6283cd24193b8d1c6040c835e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3fbe6be-34b0-4e62-9a3b-96c9278bc728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3fbe6be-34b0-4e62-9a3b-96c9278bc728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7215092-b08c-4e67-bb24-e84ada57be86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7215092-b08c-4e67-bb24-e84ada57be86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e797bdb8-4928-4ffc-80d4-578d702f9126', 'volume_name': 'volume-e797bdb8-4928-4ffc-80d4-578d702f9126', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65b10f6-5ce5-4f5a-9b79-8de56fff1c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65b10f6-5ce5-4f5a-9b79-8de56fff1c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc77035b-5ab7-4f27-9d7b-b3789bea3305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:28 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Volume e797bdb8-4928-4ffc-80d4-578d702f9126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e797bdb8-4928-4ffc-80d4-578d702f9126', 'volume_size': 1} Jun 24 10:05:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Flow 'volume_create_manager' (6211cdac-67ed-4b24-bae2-59914c939ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f5551f-a83d-4f74-9e82-c1efd1868e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f5551f-a83d-4f74-9e82-c1efd1868e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-744137321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b21e13463746908f233034d08e0056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:05:29Z,use_quota=True,user_id='84f6e6283cd24193b8d1c6040c835e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9e7dc1-ecd7-44aa-88da-c6e0767a2ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9e7dc1-ecd7-44aa-88da-c6e0767a2ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b508c9be-5c83-4597-9541-e6b2247e82ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:29 devstack sudo[112835]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b508c9be-5c83-4597-9541-e6b2247e82ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70', 'volume_name': 'volume-2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cdbec9e-ea6b-48b6-922f-24ec96849158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cdbec9e-ea6b-48b6-922f-24ec96849158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7214717f-5bd0-4cd7-b43f-71911a1196c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:29 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Volume 2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70', 'volume_size': 1} Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca646024-6b71-49e8-9c7d-39fe20fc0a3b 1073741824" returned: 0 in 1.015s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca646024-6b71-49e8-9c7d-39fe20fc0a3b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:29 devstack sudo[112841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca646024-6b71-49e8-9c7d-39fe20fc0a3b Jun 24 10:05:29 devstack sudo[112841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Flow 'volume_create_manager' (ba6e8f1f-6e82-473b-b6d0-5ff28918bd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff61b624-40cf-4b1b-a6f5-1091e3829061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff61b624-40cf-4b1b-a6f5-1091e3829061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1087631738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b3ec72a-c247-4d37-a898-75b8dff61b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b21e13463746908f233034d08e0056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:05:30Z,use_quota=True,user_id='84f6e6283cd24193b8d1c6040c835e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ad498c-b898-45bf-89e5-ead343ebbe05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ad498c-b898-45bf-89e5-ead343ebbe05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2541b758-544d-40fe-a635-da8841586f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2541b758-544d-40fe-a635-da8841586f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b3ec72a-c247-4d37-a898-75b8dff61b25', 'volume_name': 'volume-9b3ec72a-c247-4d37-a898-75b8dff61b25', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649ad016-2130-45d5-8368-60bcb5e6e3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649ad016-2130-45d5-8368-60bcb5e6e3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d260ee-04b2-4778-8889-edaa8a7f012d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:29 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Volume 9b3ec72a-c247-4d37-a898-75b8dff61b25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b3ec72a-c247-4d37-a898-75b8dff61b25', 'volume_size': 1} Jun 24 10:05:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Flow 'volume_create_manager' (2ffc9662-b99b-4afb-b31c-d1f0fec25ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15ec549-1404-4398-b636-a7256730ffe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15ec549-1404-4398-b636-a7256730ffe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-173529384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c11cff4-9a24-4153-a6b4-9d198d9d2ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b21e13463746908f233034d08e0056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:05:30Z,use_quota=True,user_id='84f6e6283cd24193b8d1c6040c835e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cad80ea-42cb-4ac3-be15-134b4073b0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cad80ea-42cb-4ac3-be15-134b4073b0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c802e1-1d92-4824-8d31-6a8428807a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c802e1-1d92-4824-8d31-6a8428807a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c11cff4-9a24-4153-a6b4-9d198d9d2ef2', 'volume_name': 'volume-7c11cff4-9a24-4153-a6b4-9d198d9d2ef2', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90db8136-cc49-4a25-a879-19b2317264c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90db8136-cc49-4a25-a879-19b2317264c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b155c7f0-3c8e-4582-8c67-d88412e5550f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:30 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Volume 7c11cff4-9a24-4153-a6b4-9d198d9d2ef2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c11cff4-9a24-4153-a6b4-9d198d9d2ef2', 'volume_size': 1} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:05:30 devstack sudo[112841]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca646024-6b71-49e8-9c7d-39fe20fc0a3b" returned: 0 in 0.813s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.351s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-352808403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e797bdb8-4928-4ffc-80d4-578d702f9126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b21e13463746908f233034d08e0056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:05:29Z,use_quota=True,user_id='84f6e6283cd24193b8d1c6040c835e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Creating volume e797bdb8-4928-4ffc-80d4-578d702f9126 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:05:30 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e797bdb8-4928-4ffc-80d4-578d702f9126 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ceacbc-4b05-47da-ad16-3c87fbef5f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca646024-6b71-49e8-9c7d-39fe20fc0a3b', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:30 devstack sudo[112844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e797bdb8-4928-4ffc-80d4-578d702f9126 1073741824 Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efce2d81-589c-4d99-8f86-c9e0efdeca51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:30 devstack sudo[112844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:30 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Volume volume-ca646024-6b71-49e8-9c7d-39fe20fc0a3b (ca646024-6b71-49e8-9c7d-39fe20fc0a3b): created successfully Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efce2d81-589c-4d99-8f86-c9e0efdeca51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:30 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Flow 'volume_create_manager' (d74b192c-d9a6-4230-a95f-c40aa496bbe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:05:30 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-dd719629-3bad-4401-b989-4e742f03f5b1 tempest-CreateVolumesFromImageTest-237759169 None] Created volume successfully. Jun 24 10:05:31 devstack sudo[112844]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e797bdb8-4928-4ffc-80d4-578d702f9126 1073741824" returned: 0 in 0.878s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e797bdb8-4928-4ffc-80d4-578d702f9126 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:31 devstack sudo[112849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e797bdb8-4928-4ffc-80d4-578d702f9126 Jun 24 10:05:31 devstack sudo[112849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:31 devstack sudo[112849]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e797bdb8-4928-4ffc-80d4-578d702f9126" returned: 0 in 0.654s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:31 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:05:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:05:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.444s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:05:31 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-744137321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b21e13463746908f233034d08e0056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:05:29Z,use_quota=True,user_id='84f6e6283cd24193b8d1c6040c835e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:05:31 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Creating volume 2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:05:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:05:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:05:31 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:05:31 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:05:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:05:31 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:05:31 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:05:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:31 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc77035b-5ab7-4f27-9d7b-b3789bea3305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e797bdb8-4928-4ffc-80d4-578d702f9126', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:31 devstack sudo[112852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70 1073741824 Jun 24 10:05:31 devstack sudo[112852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:31 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355d516e-1236-4dd3-8711-b944f33b3f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:31 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Volume volume-e797bdb8-4928-4ffc-80d4-578d702f9126 (e797bdb8-4928-4ffc-80d4-578d702f9126): created successfully Jun 24 10:05:31 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355d516e-1236-4dd3-8711-b944f33b3f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:31 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Flow 'volume_create_manager' (20e4ff01-66ae-4791-9bba-85f1f09c5810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:05:31 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-a60e0122-d6f2-4341-87b4-e8b95df21575 tempest-CreateVolumesFromImageTest-237759169 None] Created volume successfully. Jun 24 10:05:32 devstack sudo[112852]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70 1073741824" returned: 0 in 0.813s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:32 devstack sudo[112858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70 Jun 24 10:05:32 devstack sudo[112858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:33 devstack sudo[112858]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70" returned: 0 in 0.692s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:05:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:05:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.590s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:05:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1087631738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b3ec72a-c247-4d37-a898-75b8dff61b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b21e13463746908f233034d08e0056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:05:30Z,use_quota=True,user_id='84f6e6283cd24193b8d1c6040c835e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:05:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Creating volume 9b3ec72a-c247-4d37-a898-75b8dff61b25 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:05:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:05:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:05:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:05:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:05:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:05:33 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:05:33 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:05:33 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9b3ec72a-c247-4d37-a898-75b8dff61b25 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:33 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7214717f-5bd0-4cd7-b43f-71911a1196c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:33 devstack sudo[112861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9b3ec72a-c247-4d37-a898-75b8dff61b25 1073741824 Jun 24 10:05:33 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d24ac5-5331-4177-9197-c2b90838a2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:33 devstack sudo[112861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:33 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Volume volume-2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70 (2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70): created successfully Jun 24 10:05:33 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d24ac5-5331-4177-9197-c2b90838a2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:33 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Flow 'volume_create_manager' (6211cdac-67ed-4b24-bae2-59914c939ac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:05:33 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-8821d0c8-eeba-4922-bbc5-0e3e3987ca95 tempest-CreateVolumesFromImageTest-237759169 None] Created volume successfully. Jun 24 10:05:34 devstack sudo[112861]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9b3ec72a-c247-4d37-a898-75b8dff61b25 1073741824" returned: 0 in 0.875s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9b3ec72a-c247-4d37-a898-75b8dff61b25 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:34 devstack sudo[112867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9b3ec72a-c247-4d37-a898-75b8dff61b25 Jun 24 10:05:34 devstack sudo[112867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:34 devstack sudo[112867]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9b3ec72a-c247-4d37-a898-75b8dff61b25" returned: 0 in 0.639s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:34 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:05:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:05:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.724s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:05:34 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-173529384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c11cff4-9a24-4153-a6b4-9d198d9d2ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b21e13463746908f233034d08e0056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:05:30Z,use_quota=True,user_id='84f6e6283cd24193b8d1c6040c835e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:05:34 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Creating volume 7c11cff4-9a24-4153-a6b4-9d198d9d2ef2 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:05:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:05:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:05:34 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:05:34 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:05:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:05:34 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:05:34 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:05:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c11cff4-9a24-4153-a6b4-9d198d9d2ef2 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:35 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d260ee-04b2-4778-8889-edaa8a7f012d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b3ec72a-c247-4d37-a898-75b8dff61b25', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:35 devstack sudo[112870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c11cff4-9a24-4153-a6b4-9d198d9d2ef2 1073741824 Jun 24 10:05:35 devstack sudo[112870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:35 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c653f9-85dc-4b43-b34f-5646cf8fc4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:35 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Volume volume-9b3ec72a-c247-4d37-a898-75b8dff61b25 (9b3ec72a-c247-4d37-a898-75b8dff61b25): created successfully Jun 24 10:05:35 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c653f9-85dc-4b43-b34f-5646cf8fc4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:35 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Flow 'volume_create_manager' (ba6e8f1f-6e82-473b-b6d0-5ff28918bd3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:05:35 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-8230c4ef-b558-4201-9aed-b58ac10cb776 tempest-CreateVolumesFromImageTest-237759169 None] Created volume successfully. Jun 24 10:05:35 devstack sudo[112870]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c11cff4-9a24-4153-a6b4-9d198d9d2ef2 1073741824" returned: 0 in 0.838s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c11cff4-9a24-4153-a6b4-9d198d9d2ef2 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:35 devstack sudo[112875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c11cff4-9a24-4153-a6b4-9d198d9d2ef2 Jun 24 10:05:35 devstack sudo[112875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:36 devstack sudo[112875]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c11cff4-9a24-4153-a6b4-9d198d9d2ef2" returned: 0 in 0.628s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:05:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:05:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b155c7f0-3c8e-4582-8c67-d88412e5550f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c11cff4-9a24-4153-a6b4-9d198d9d2ef2', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cce5545-4382-49b1-bfda-e6017c8a5d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:05:36 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Volume volume-7c11cff4-9a24-4153-a6b4-9d198d9d2ef2 (7c11cff4-9a24-4153-a6b4-9d198d9d2ef2): created successfully Jun 24 10:05:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cce5545-4382-49b1-bfda-e6017c8a5d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:05:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Flow 'volume_create_manager' (2ffc9662-b99b-4afb-b31c-d1f0fec25ff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:05:36 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-0aadf7b3-7151-4b5a-868d-4a4002c5e6bf tempest-CreateVolumesFromImageTest-237759169 None] Created volume successfully. Jun 24 10:05:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d718aa58-d34c-4218-bbee-cd4c0dcf6d40 tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "cinder-7c11cff4-9a24-4153-a6b4-9d198d9d2ef2-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:05:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d718aa58-d34c-4218-bbee-cd4c0dcf6d40 tempest-CreateVolumesFromImageTest-237759169 None] Lock "cinder-7c11cff4-9a24-4153-a6b4-9d198d9d2ef2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:05:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d718aa58-d34c-4218-bbee-cd4c0dcf6d40 tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "cinder-quobyte-7c11cff4-9a24-4153-a6b4-9d198d9d2ef2" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:05:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d718aa58-d34c-4218-bbee-cd4c0dcf6d40 tempest-CreateVolumesFromImageTest-237759169 None] Lock "cinder-quobyte-7c11cff4-9a24-4153-a6b4-9d198d9d2ef2" acquired by "delete_volume" :: waited 0.014s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:05:36 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7613bd86-a218-41a3-a1e2-0fadcfb21c3c]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:05:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d718aa58-d34c-4218-bbee-cd4c0dcf6d40 tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c11cff4-9a24-4153-a6b4-9d198d9d2ef2 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:36 devstack sudo[112878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c11cff4-9a24-4153-a6b4-9d198d9d2ef2 Jun 24 10:05:36 devstack sudo[112878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:37 devstack sudo[112878]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d718aa58-d34c-4218-bbee-cd4c0dcf6d40 tempest-CreateVolumesFromImageTest-237759169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c11cff4-9a24-4153-a6b4-9d198d9d2ef2" returned: 0 in 0.724s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d718aa58-d34c-4218-bbee-cd4c0dcf6d40 tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c11cff4-9a24-4153-a6b4-9d198d9d2ef2 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:37 devstack sudo[112884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c11cff4-9a24-4153-a6b4-9d198d9d2ef2 Jun 24 10:05:37 devstack sudo[112884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:38 devstack sudo[112884]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d718aa58-d34c-4218-bbee-cd4c0dcf6d40 tempest-CreateVolumesFromImageTest-237759169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7c11cff4-9a24-4153-a6b4-9d198d9d2ef2" returned: 0 in 0.658s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:38 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d718aa58-d34c-4218-bbee-cd4c0dcf6d40 tempest-CreateVolumesFromImageTest-237759169 None] Lock "cinder-quobyte-7c11cff4-9a24-4153-a6b4-9d198d9d2ef2" released by "delete_volume" :: held 1.418s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:05:38 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-d718aa58-d34c-4218-bbee-cd4c0dcf6d40 tempest-CreateVolumesFromImageTest-237759169 None] Created reservations ['a7fb1588-5bf0-4446-86fb-3fd95456f063', '44969ed2-8518-4cee-8034-707b03b7bb7a', '9b645458-03b9-4384-826a-2e536acfe96d', 'd9b5fc60-9e2b-436c-b7a9-f2bc489854f9'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:05:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d718aa58-d34c-4218-bbee-cd4c0dcf6d40 tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:05:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d718aa58-d34c-4218-bbee-cd4c0dcf6d40 tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:05:38 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d718aa58-d34c-4218-bbee-cd4c0dcf6d40 tempest-CreateVolumesFromImageTest-237759169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:05:38 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d718aa58-d34c-4218-bbee-cd4c0dcf6d40 tempest-CreateVolumesFromImageTest-237759169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:05:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d718aa58-d34c-4218-bbee-cd4c0dcf6d40 tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:05:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d718aa58-d34c-4218-bbee-cd4c0dcf6d40 tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:38 devstack sudo[112887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:05:38 devstack sudo[112887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:38 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8ce616bd-6b2b-49d4-9ac6-51a6ba676e75 tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "cinder-9b3ec72a-c247-4d37-a898-75b8dff61b25-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:05:38 devstack sudo[112887]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d718aa58-d34c-4218-bbee-cd4c0dcf6d40 tempest-CreateVolumesFromImageTest-237759169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.641s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:38 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-d718aa58-d34c-4218-bbee-cd4c0dcf6d40 tempest-CreateVolumesFromImageTest-237759169 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:05:38 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8ce616bd-6b2b-49d4-9ac6-51a6ba676e75 tempest-CreateVolumesFromImageTest-237759169 None] Lock "cinder-9b3ec72a-c247-4d37-a898-75b8dff61b25-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:05:38 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-d718aa58-d34c-4218-bbee-cd4c0dcf6d40 tempest-CreateVolumesFromImageTest-237759169 None] Deleted volume successfully. Jun 24 10:05:38 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d718aa58-d34c-4218-bbee-cd4c0dcf6d40 tempest-CreateVolumesFromImageTest-237759169 None] Lock "cinder-7c11cff4-9a24-4153-a6b4-9d198d9d2ef2-delete_volume" released by "delete_volume" :: held 2.252s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:05:38 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8ce616bd-6b2b-49d4-9ac6-51a6ba676e75 tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "cinder-quobyte-9b3ec72a-c247-4d37-a898-75b8dff61b25" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:05:38 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8ce616bd-6b2b-49d4-9ac6-51a6ba676e75 tempest-CreateVolumesFromImageTest-237759169 None] Lock "cinder-quobyte-9b3ec72a-c247-4d37-a898-75b8dff61b25" acquired by "delete_volume" :: waited 0.017s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:05:38 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8a60ba-0315-4a70-9146-a5e6ec2e5b16]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:05:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8ce616bd-6b2b-49d4-9ac6-51a6ba676e75 tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9b3ec72a-c247-4d37-a898-75b8dff61b25 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:39 devstack sudo[112890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9b3ec72a-c247-4d37-a898-75b8dff61b25 Jun 24 10:05:39 devstack sudo[112890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:39 devstack sudo[112890]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8ce616bd-6b2b-49d4-9ac6-51a6ba676e75 tempest-CreateVolumesFromImageTest-237759169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9b3ec72a-c247-4d37-a898-75b8dff61b25" returned: 0 in 0.774s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8ce616bd-6b2b-49d4-9ac6-51a6ba676e75 tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9b3ec72a-c247-4d37-a898-75b8dff61b25 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:39 devstack sudo[112895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9b3ec72a-c247-4d37-a898-75b8dff61b25 Jun 24 10:05:39 devstack sudo[112895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:40 devstack sudo[112895]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8ce616bd-6b2b-49d4-9ac6-51a6ba676e75 tempest-CreateVolumesFromImageTest-237759169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9b3ec72a-c247-4d37-a898-75b8dff61b25" returned: 0 in 0.678s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8ce616bd-6b2b-49d4-9ac6-51a6ba676e75 tempest-CreateVolumesFromImageTest-237759169 None] Lock "cinder-quobyte-9b3ec72a-c247-4d37-a898-75b8dff61b25" released by "delete_volume" :: held 1.506s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:05:40 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-8ce616bd-6b2b-49d4-9ac6-51a6ba676e75 tempest-CreateVolumesFromImageTest-237759169 None] Created reservations ['445b8d0b-2133-4053-86c3-00009a368949', '7b5bf4d4-8ef2-4589-bd33-b4a40147ae50', '01a7675f-250e-45d6-be98-0c6e79609de2', 'e0de92cf-7f59-4235-9130-5dafef8a740f'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:05:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8ce616bd-6b2b-49d4-9ac6-51a6ba676e75 tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:05:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8ce616bd-6b2b-49d4-9ac6-51a6ba676e75 tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:05:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8ce616bd-6b2b-49d4-9ac6-51a6ba676e75 tempest-CreateVolumesFromImageTest-237759169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:05:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8ce616bd-6b2b-49d4-9ac6-51a6ba676e75 tempest-CreateVolumesFromImageTest-237759169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:05:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8ce616bd-6b2b-49d4-9ac6-51a6ba676e75 tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:05:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8ce616bd-6b2b-49d4-9ac6-51a6ba676e75 tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:40 devstack sudo[112898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:05:40 devstack sudo[112898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2a3a75bc-291c-4bb1-8ede-5ff35c0289fd tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "cinder-2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:05:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2a3a75bc-291c-4bb1-8ede-5ff35c0289fd tempest-CreateVolumesFromImageTest-237759169 None] Lock "cinder-2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:05:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2a3a75bc-291c-4bb1-8ede-5ff35c0289fd tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "cinder-quobyte-2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:05:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2a3a75bc-291c-4bb1-8ede-5ff35c0289fd tempest-CreateVolumesFromImageTest-237759169 None] Lock "cinder-quobyte-2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70" acquired by "delete_volume" :: waited 0.018s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:05:41 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e49d560-1478-4c1f-aedc-e9143aeb2f28]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:05:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2a3a75bc-291c-4bb1-8ede-5ff35c0289fd tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:41 devstack sudo[112898]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8ce616bd-6b2b-49d4-9ac6-51a6ba676e75 tempest-CreateVolumesFromImageTest-237759169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.678s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:41 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-8ce616bd-6b2b-49d4-9ac6-51a6ba676e75 tempest-CreateVolumesFromImageTest-237759169 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:05:41 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-8ce616bd-6b2b-49d4-9ac6-51a6ba676e75 tempest-CreateVolumesFromImageTest-237759169 None] Deleted volume successfully. Jun 24 10:05:41 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-8ce616bd-6b2b-49d4-9ac6-51a6ba676e75 tempest-CreateVolumesFromImageTest-237759169 None] Lock "cinder-9b3ec72a-c247-4d37-a898-75b8dff61b25-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:05:41 devstack sudo[112901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70 Jun 24 10:05:41 devstack sudo[112901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:42 devstack sudo[112901]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2a3a75bc-291c-4bb1-8ede-5ff35c0289fd tempest-CreateVolumesFromImageTest-237759169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70" returned: 0 in 0.788s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2a3a75bc-291c-4bb1-8ede-5ff35c0289fd tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:42 devstack sudo[112911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70 Jun 24 10:05:42 devstack sudo[112911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:42 devstack sudo[112911]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2a3a75bc-291c-4bb1-8ede-5ff35c0289fd tempest-CreateVolumesFromImageTest-237759169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70" returned: 0 in 0.715s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:42 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2a3a75bc-291c-4bb1-8ede-5ff35c0289fd tempest-CreateVolumesFromImageTest-237759169 None] Lock "cinder-quobyte-2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70" released by "delete_volume" :: held 1.545s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:05:42 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-2a3a75bc-291c-4bb1-8ede-5ff35c0289fd tempest-CreateVolumesFromImageTest-237759169 None] Created reservations ['25dc0270-0d17-4734-b3dd-6aa6602f8f3f', '094b25ff-dfb7-4904-83d2-cad76adeac2b', '2f847423-c5d8-4ed9-9bec-4e55f747d280', '0a0b9bbf-a6fa-4d55-a94d-c604c52d86ac'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:05:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2a3a75bc-291c-4bb1-8ede-5ff35c0289fd tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:05:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2a3a75bc-291c-4bb1-8ede-5ff35c0289fd tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:05:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2a3a75bc-291c-4bb1-8ede-5ff35c0289fd tempest-CreateVolumesFromImageTest-237759169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:05:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2a3a75bc-291c-4bb1-8ede-5ff35c0289fd tempest-CreateVolumesFromImageTest-237759169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:05:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2a3a75bc-291c-4bb1-8ede-5ff35c0289fd tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:05:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2a3a75bc-291c-4bb1-8ede-5ff35c0289fd tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:42 devstack sudo[112915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:05:42 devstack sudo[112915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-64bc8529-c131-4ff7-8d9c-526c58f58226 tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "cinder-e797bdb8-4928-4ffc-80d4-578d702f9126-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:05:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-64bc8529-c131-4ff7-8d9c-526c58f58226 tempest-CreateVolumesFromImageTest-237759169 None] Lock "cinder-e797bdb8-4928-4ffc-80d4-578d702f9126-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:05:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-64bc8529-c131-4ff7-8d9c-526c58f58226 tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "cinder-quobyte-e797bdb8-4928-4ffc-80d4-578d702f9126" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:05:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-64bc8529-c131-4ff7-8d9c-526c58f58226 tempest-CreateVolumesFromImageTest-237759169 None] Lock "cinder-quobyte-e797bdb8-4928-4ffc-80d4-578d702f9126" acquired by "delete_volume" :: waited 0.023s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:05:43 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8686fbb3-eae5-4cff-b042-98c6c9633a75]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:05:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-64bc8529-c131-4ff7-8d9c-526c58f58226 tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e797bdb8-4928-4ffc-80d4-578d702f9126 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:43 devstack sudo[112915]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2a3a75bc-291c-4bb1-8ede-5ff35c0289fd tempest-CreateVolumesFromImageTest-237759169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.727s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:43 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2a3a75bc-291c-4bb1-8ede-5ff35c0289fd tempest-CreateVolumesFromImageTest-237759169 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:05:43 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-2a3a75bc-291c-4bb1-8ede-5ff35c0289fd tempest-CreateVolumesFromImageTest-237759169 None] Deleted volume successfully. Jun 24 10:05:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2a3a75bc-291c-4bb1-8ede-5ff35c0289fd tempest-CreateVolumesFromImageTest-237759169 None] Lock "cinder-2ad7ef5c-d9a6-4a31-9259-c38f5b3a7f70-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:05:43 devstack sudo[112918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e797bdb8-4928-4ffc-80d4-578d702f9126 Jun 24 10:05:43 devstack sudo[112918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:44 devstack sudo[112918]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-64bc8529-c131-4ff7-8d9c-526c58f58226 tempest-CreateVolumesFromImageTest-237759169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e797bdb8-4928-4ffc-80d4-578d702f9126" returned: 0 in 0.868s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-64bc8529-c131-4ff7-8d9c-526c58f58226 tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e797bdb8-4928-4ffc-80d4-578d702f9126 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:44 devstack sudo[112925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e797bdb8-4928-4ffc-80d4-578d702f9126 Jun 24 10:05:44 devstack sudo[112925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:45 devstack sudo[112925]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-64bc8529-c131-4ff7-8d9c-526c58f58226 tempest-CreateVolumesFromImageTest-237759169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e797bdb8-4928-4ffc-80d4-578d702f9126" returned: 0 in 0.654s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-64bc8529-c131-4ff7-8d9c-526c58f58226 tempest-CreateVolumesFromImageTest-237759169 None] Lock "cinder-quobyte-e797bdb8-4928-4ffc-80d4-578d702f9126" released by "delete_volume" :: held 1.582s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:05:45 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-64bc8529-c131-4ff7-8d9c-526c58f58226 tempest-CreateVolumesFromImageTest-237759169 None] Created reservations ['55c081d7-6ce8-46e6-8551-747c9b96935c', 'b25eed78-8e67-41ac-9084-268e5f258363', '5c1bd12f-3ff6-41aa-9950-4ec1162102e5', '74b02a89-6b25-48d8-aac0-50a6e53400cd'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:05:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-64bc8529-c131-4ff7-8d9c-526c58f58226 tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:05:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-64bc8529-c131-4ff7-8d9c-526c58f58226 tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:05:45 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-64bc8529-c131-4ff7-8d9c-526c58f58226 tempest-CreateVolumesFromImageTest-237759169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:05:45 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-64bc8529-c131-4ff7-8d9c-526c58f58226 tempest-CreateVolumesFromImageTest-237759169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:05:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-64bc8529-c131-4ff7-8d9c-526c58f58226 tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:05:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-64bc8529-c131-4ff7-8d9c-526c58f58226 tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:45 devstack sudo[112928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:05:45 devstack sudo[112928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1dc4ca02-007b-4a4f-b8e5-5ef5dbba159a tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "cinder-ca646024-6b71-49e8-9c7d-39fe20fc0a3b-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:05:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1dc4ca02-007b-4a4f-b8e5-5ef5dbba159a tempest-CreateVolumesFromImageTest-237759169 None] Lock "cinder-ca646024-6b71-49e8-9c7d-39fe20fc0a3b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:05:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1dc4ca02-007b-4a4f-b8e5-5ef5dbba159a tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "cinder-quobyte-ca646024-6b71-49e8-9c7d-39fe20fc0a3b" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:05:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1dc4ca02-007b-4a4f-b8e5-5ef5dbba159a tempest-CreateVolumesFromImageTest-237759169 None] Lock "cinder-quobyte-ca646024-6b71-49e8-9c7d-39fe20fc0a3b" acquired by "delete_volume" :: waited 0.022s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:05:45 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be10827-e5bc-4660-96c6-e4231563b94a]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:05:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1dc4ca02-007b-4a4f-b8e5-5ef5dbba159a tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca646024-6b71-49e8-9c7d-39fe20fc0a3b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:45 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-2b450638-0283-4a7a-84e2-ec60ce02e306 req-6137c290-d485-44c4-b799-e8f80cad61ef tempest-TestMinimumBasicScenario-32333345 None] Terminate volume connection completed successfully. Jun 24 10:05:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-2b450638-0283-4a7a-84e2-ec60ce02e306 req-6137c290-d485-44c4-b799-e8f80cad61ef tempest-TestMinimumBasicScenario-32333345 None] Deleting attachment d0ace6e7-9ddb-4685-a250-0269ee822226. {{(pid=93447) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 10:05:45 devstack sudo[112928]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-64bc8529-c131-4ff7-8d9c-526c58f58226 tempest-CreateVolumesFromImageTest-237759169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.702s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:45 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-64bc8529-c131-4ff7-8d9c-526c58f58226 tempest-CreateVolumesFromImageTest-237759169 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:05:45 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-64bc8529-c131-4ff7-8d9c-526c58f58226 tempest-CreateVolumesFromImageTest-237759169 None] Deleted volume successfully. Jun 24 10:05:45 devstack sudo[112936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca646024-6b71-49e8-9c7d-39fe20fc0a3b Jun 24 10:05:45 devstack sudo[112936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-64bc8529-c131-4ff7-8d9c-526c58f58226 tempest-CreateVolumesFromImageTest-237759169 None] Lock "cinder-e797bdb8-4928-4ffc-80d4-578d702f9126-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:05:46 devstack sudo[112936]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1dc4ca02-007b-4a4f-b8e5-5ef5dbba159a tempest-CreateVolumesFromImageTest-237759169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca646024-6b71-49e8-9c7d-39fe20fc0a3b" returned: 0 in 0.824s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1dc4ca02-007b-4a4f-b8e5-5ef5dbba159a tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca646024-6b71-49e8-9c7d-39fe20fc0a3b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:46 devstack sudo[112942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca646024-6b71-49e8-9c7d-39fe20fc0a3b Jun 24 10:05:46 devstack sudo[112942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:47 devstack sudo[112942]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1dc4ca02-007b-4a4f-b8e5-5ef5dbba159a tempest-CreateVolumesFromImageTest-237759169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ca646024-6b71-49e8-9c7d-39fe20fc0a3b" returned: 0 in 0.646s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1dc4ca02-007b-4a4f-b8e5-5ef5dbba159a tempest-CreateVolumesFromImageTest-237759169 None] Lock "cinder-quobyte-ca646024-6b71-49e8-9c7d-39fe20fc0a3b" released by "delete_volume" :: held 1.526s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:05:47 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-1dc4ca02-007b-4a4f-b8e5-5ef5dbba159a tempest-CreateVolumesFromImageTest-237759169 None] Created reservations ['198e9f1b-7cae-44bf-8b23-28017b7d3c78', '143c3305-f83c-453b-af9d-7878ead193e3', 'dde13380-566a-46a9-9d31-587626199291', '2a81908a-1468-451e-8820-ba6767a09cac'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:05:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1dc4ca02-007b-4a4f-b8e5-5ef5dbba159a tempest-CreateVolumesFromImageTest-237759169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:05:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1dc4ca02-007b-4a4f-b8e5-5ef5dbba159a tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:05:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1dc4ca02-007b-4a4f-b8e5-5ef5dbba159a tempest-CreateVolumesFromImageTest-237759169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:05:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1dc4ca02-007b-4a4f-b8e5-5ef5dbba159a tempest-CreateVolumesFromImageTest-237759169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:05:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1dc4ca02-007b-4a4f-b8e5-5ef5dbba159a tempest-CreateVolumesFromImageTest-237759169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:05:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1dc4ca02-007b-4a4f-b8e5-5ef5dbba159a tempest-CreateVolumesFromImageTest-237759169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:47 devstack sudo[112946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:05:47 devstack sudo[112946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b2a16c80-7dce-4b05-a85b-313ca54b19ce tempest-TestMinimumBasicScenario-32333345 None] Acquiring lock "cinder-f2e1637b-44dc-4d92-a98e-a84b12d16c40-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:05:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b2a16c80-7dce-4b05-a85b-313ca54b19ce tempest-TestMinimumBasicScenario-32333345 None] Lock "cinder-f2e1637b-44dc-4d92-a98e-a84b12d16c40-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:05:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b2a16c80-7dce-4b05-a85b-313ca54b19ce tempest-TestMinimumBasicScenario-32333345 None] Acquiring lock "cinder-quobyte-f2e1637b-44dc-4d92-a98e-a84b12d16c40" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:05:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b2a16c80-7dce-4b05-a85b-313ca54b19ce tempest-TestMinimumBasicScenario-32333345 None] Lock "cinder-quobyte-f2e1637b-44dc-4d92-a98e-a84b12d16c40" acquired by "delete_volume" :: waited 0.015s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:05:47 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b5f4a1-6135-47df-9c49-c90294cbd8d1]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:05:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b2a16c80-7dce-4b05-a85b-313ca54b19ce tempest-TestMinimumBasicScenario-32333345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f2e1637b-44dc-4d92-a98e-a84b12d16c40 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:47 devstack sudo[112948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f2e1637b-44dc-4d92-a98e-a84b12d16c40 Jun 24 10:05:47 devstack sudo[112948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:48 devstack sudo[112946]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1dc4ca02-007b-4a4f-b8e5-5ef5dbba159a tempest-CreateVolumesFromImageTest-237759169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.663s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:48 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-1dc4ca02-007b-4a4f-b8e5-5ef5dbba159a tempest-CreateVolumesFromImageTest-237759169 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:05:48 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-1dc4ca02-007b-4a4f-b8e5-5ef5dbba159a tempest-CreateVolumesFromImageTest-237759169 None] Deleted volume successfully. Jun 24 10:05:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1dc4ca02-007b-4a4f-b8e5-5ef5dbba159a tempest-CreateVolumesFromImageTest-237759169 None] Lock "cinder-ca646024-6b71-49e8-9c7d-39fe20fc0a3b-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:05:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b2a16c80-7dce-4b05-a85b-313ca54b19ce tempest-TestMinimumBasicScenario-32333345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f2e1637b-44dc-4d92-a98e-a84b12d16c40" returned: 0 in 0.781s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b2a16c80-7dce-4b05-a85b-313ca54b19ce tempest-TestMinimumBasicScenario-32333345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f2e1637b-44dc-4d92-a98e-a84b12d16c40 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:48 devstack sudo[112948]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:48 devstack sudo[112962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f2e1637b-44dc-4d92-a98e-a84b12d16c40 Jun 24 10:05:48 devstack sudo[112962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:49 devstack sudo[112962]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b2a16c80-7dce-4b05-a85b-313ca54b19ce tempest-TestMinimumBasicScenario-32333345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-f2e1637b-44dc-4d92-a98e-a84b12d16c40" returned: 0 in 0.698s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:49 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b2a16c80-7dce-4b05-a85b-313ca54b19ce tempest-TestMinimumBasicScenario-32333345 None] Lock "cinder-quobyte-f2e1637b-44dc-4d92-a98e-a84b12d16c40" released by "delete_volume" :: held 1.522s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:05:49 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-b2a16c80-7dce-4b05-a85b-313ca54b19ce tempest-TestMinimumBasicScenario-32333345 None] Created reservations ['be0b1aed-9a37-4011-b648-d5cceb42f657', '4dce9086-edee-483b-a8f8-e66921564242', 'c54f7d86-2758-4ef6-9f94-f67117a87b03', 'fff3acc4-0267-4e53-b79b-ea0416527f7c'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:05:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b2a16c80-7dce-4b05-a85b-313ca54b19ce tempest-TestMinimumBasicScenario-32333345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:05:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b2a16c80-7dce-4b05-a85b-313ca54b19ce tempest-TestMinimumBasicScenario-32333345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:05:49 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b2a16c80-7dce-4b05-a85b-313ca54b19ce tempest-TestMinimumBasicScenario-32333345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:05:49 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-b2a16c80-7dce-4b05-a85b-313ca54b19ce tempest-TestMinimumBasicScenario-32333345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:05:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-b2a16c80-7dce-4b05-a85b-313ca54b19ce tempest-TestMinimumBasicScenario-32333345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:05:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b2a16c80-7dce-4b05-a85b-313ca54b19ce tempest-TestMinimumBasicScenario-32333345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:05:49 devstack sudo[112965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:05:49 devstack sudo[112965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:05:50 devstack sudo[112965]: pam_unix(sudo:session): session closed for user root Jun 24 10:05:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-b2a16c80-7dce-4b05-a85b-313ca54b19ce tempest-TestMinimumBasicScenario-32333345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.701s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:05:50 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-b2a16c80-7dce-4b05-a85b-313ca54b19ce tempest-TestMinimumBasicScenario-32333345 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:05:50 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-b2a16c80-7dce-4b05-a85b-313ca54b19ce tempest-TestMinimumBasicScenario-32333345 None] Deleted volume successfully. Jun 24 10:05:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-b2a16c80-7dce-4b05-a85b-313ca54b19ce tempest-TestMinimumBasicScenario-32333345 None] Lock "cinder-f2e1637b-44dc-4d92-a98e-a84b12d16c40-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:05:59 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:UPDATE=68,cinder:SELECT=43,cinder:INSERT=14,cinder:DELETE=2 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 10:06:00 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=39,cinder:UPDATE=58,cinder:INSERT=15,cinder:DELETE=9 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 10:06:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 10:06:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:06:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:06:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:06:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:06:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:06:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:06:25 devstack sudo[113034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:06:25 devstack sudo[113034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:06:25 devstack sudo[113034]: pam_unix(sudo:session): session closed for user root Jun 24 10:06:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.706s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:06:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:06:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 10:06:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 28 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 10:06:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 10:06:49 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=1 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 10:06:49 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:UPDATE=1 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 10:07:03 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:07:03 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Flow 'volume_create_manager' (1aaf6388-d2d1-457c-8fb2-65229fe2377b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:07:03 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1a8e09-bc7f-4838-89b7-970d4790f30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:03 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1a8e09-bc7f-4838-89b7-970d4790f30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2085365236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b62b5f30-70c4-47bf-b573-a7ac4a9fed62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbec09332b3e40bc864322295843dea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:07:04Z,use_quota=True,user_id='4f542b231c494125a2677d22d0ac079c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:03 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (486bdb88-0d4e-4def-8fcd-ac1cb5ca280f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:03 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (486bdb88-0d4e-4def-8fcd-ac1cb5ca280f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:03 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24fd3a95-6eaa-4252-8b2f-3f2c58633886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:03 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24fd3a95-6eaa-4252-8b2f-3f2c58633886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b62b5f30-70c4-47bf-b573-a7ac4a9fed62', 'volume_name': 'volume-b62b5f30-70c4-47bf-b573-a7ac4a9fed62', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:03 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62338c0-0c58-40eb-87a2-aa0c978d2129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:03 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62338c0-0c58-40eb-87a2-aa0c978d2129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:03 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e6d6623-e495-4e27-977e-6da23873e0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:03 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Volume b62b5f30-70c4-47bf-b573-a7ac4a9fed62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b62b5f30-70c4-47bf-b573-a7ac4a9fed62', 'volume_size': 1} Jun 24 10:07:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:07:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:07:03 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2085365236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b62b5f30-70c4-47bf-b573-a7ac4a9fed62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbec09332b3e40bc864322295843dea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:07:04Z,use_quota=True,user_id='4f542b231c494125a2677d22d0ac079c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:07:03 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Creating volume b62b5f30-70c4-47bf-b573-a7ac4a9fed62 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:07:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:07:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:07:03 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:07:03 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:07:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:07:03 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:07:03 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:07:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b62b5f30-70c4-47bf-b573-a7ac4a9fed62 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:03 devstack sudo[113219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b62b5f30-70c4-47bf-b573-a7ac4a9fed62 1073741824 Jun 24 10:07:03 devstack sudo[113219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:04 devstack sudo[113219]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b62b5f30-70c4-47bf-b573-a7ac4a9fed62 1073741824" returned: 0 in 0.782s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b62b5f30-70c4-47bf-b573-a7ac4a9fed62 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:04 devstack sudo[113225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b62b5f30-70c4-47bf-b573-a7ac4a9fed62 Jun 24 10:07:04 devstack sudo[113225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:05 devstack sudo[113225]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b62b5f30-70c4-47bf-b573-a7ac4a9fed62" returned: 0 in 0.644s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:05 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:07:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:07:05 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e6d6623-e495-4e27-977e-6da23873e0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b62b5f30-70c4-47bf-b573-a7ac4a9fed62', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:05 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec996ed-341b-40fa-8a90-01e4e619f699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:05 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Volume volume-b62b5f30-70c4-47bf-b573-a7ac4a9fed62 (b62b5f30-70c4-47bf-b573-a7ac4a9fed62): created successfully Jun 24 10:07:05 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec996ed-341b-40fa-8a90-01e4e619f699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:05 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Flow 'volume_create_manager' (1aaf6388-d2d1-457c-8fb2-65229fe2377b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:07:05 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-8d7f1144-993f-4b87-8a1b-58c50fe2ecdd tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Created volume successfully. Jun 24 10:07:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-a44138d7-4698-4ba7-91b7-dd9ecb112df8 req-48a706c4-f4f4-40ad-9c3d-5b698d0ff144 tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:07:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-a44138d7-4698-4ba7-91b7-dd9ecb112df8 req-48a706c4-f4f4-40ad-9c3d-5b698d0ff144 tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:07:08 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac795675-23e0-4458-8c00-ca1891e28c1f]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:07:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-a44138d7-4698-4ba7-91b7-dd9ecb112df8 req-48a706c4-f4f4-40ad-9c3d-5b698d0ff144 tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b62b5f30-70c4-47bf-b573-a7ac4a9fed62 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:08 devstack sudo[113239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b62b5f30-70c4-47bf-b573-a7ac4a9fed62 Jun 24 10:07:08 devstack sudo[113239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:09 devstack sudo[113239]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [req-a44138d7-4698-4ba7-91b7-dd9ecb112df8 req-48a706c4-f4f4-40ad-9c3d-5b698d0ff144 tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b62b5f30-70c4-47bf-b573-a7ac4a9fed62" returned: 0 in 0.734s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [req-a44138d7-4698-4ba7-91b7-dd9ecb112df8 req-48a706c4-f4f4-40ad-9c3d-5b698d0ff144 tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.749s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:07:09 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-a44138d7-4698-4ba7-91b7-dd9ecb112df8 req-48a706c4-f4f4-40ad-9c3d-5b698d0ff144 tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb', 'name': 'volume-b62b5f30-70c4-47bf-b573-a7ac4a9fed62', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed431b11-7b60-4def-beb7-2c5e80e34799', 'enforce_multipath': True} {{(pid=93447) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 24 10:07:09 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-a44138d7-4698-4ba7-91b7-dd9ecb112df8 req-48a706c4-f4f4-40ad-9c3d-5b698d0ff144 tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] attachment_update completed successfully. Jun 24 10:07:15 devstack cinder-volume[93447]: INFO cinder.volume.manager [req-b5959388-11f6-4470-9d63-f5831ff61efb req-8e951753-129c-4df2-ab65-8f3dba0d3e59 tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Terminate volume connection completed successfully. Jun 24 10:07:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [req-b5959388-11f6-4470-9d63-f5831ff61efb req-8e951753-129c-4df2-ab65-8f3dba0d3e59 tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Deleting attachment ed431b11-7b60-4def-beb7-2c5e80e34799. {{(pid=93447) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 24 10:07:17 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-cd1f789e-38c2-478c-a0e9-fb34f9d6700f tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Acquiring lock "cinder-b62b5f30-70c4-47bf-b573-a7ac4a9fed62-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:07:17 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-cd1f789e-38c2-478c-a0e9-fb34f9d6700f tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Lock "cinder-b62b5f30-70c4-47bf-b573-a7ac4a9fed62-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:07:17 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-cd1f789e-38c2-478c-a0e9-fb34f9d6700f tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Acquiring lock "cinder-quobyte-b62b5f30-70c4-47bf-b573-a7ac4a9fed62" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:07:17 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-cd1f789e-38c2-478c-a0e9-fb34f9d6700f tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Lock "cinder-quobyte-b62b5f30-70c4-47bf-b573-a7ac4a9fed62" acquired by "delete_volume" :: waited 0.016s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:07:17 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdac379-ec8d-4600-96bf-96b82b639c6c]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:07:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cd1f789e-38c2-478c-a0e9-fb34f9d6700f tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b62b5f30-70c4-47bf-b573-a7ac4a9fed62 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:17 devstack sudo[113660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b62b5f30-70c4-47bf-b573-a7ac4a9fed62 Jun 24 10:07:17 devstack sudo[113660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:18 devstack sudo[113660]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cd1f789e-38c2-478c-a0e9-fb34f9d6700f tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b62b5f30-70c4-47bf-b573-a7ac4a9fed62" returned: 0 in 0.744s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cd1f789e-38c2-478c-a0e9-fb34f9d6700f tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b62b5f30-70c4-47bf-b573-a7ac4a9fed62 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:18 devstack sudo[113665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b62b5f30-70c4-47bf-b573-a7ac4a9fed62 Jun 24 10:07:18 devstack sudo[113665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:19 devstack sudo[113665]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cd1f789e-38c2-478c-a0e9-fb34f9d6700f tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b62b5f30-70c4-47bf-b573-a7ac4a9fed62" returned: 0 in 0.628s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:19 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-cd1f789e-38c2-478c-a0e9-fb34f9d6700f tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Lock "cinder-quobyte-b62b5f30-70c4-47bf-b573-a7ac4a9fed62" released by "delete_volume" :: held 1.418s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:07:19 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-cd1f789e-38c2-478c-a0e9-fb34f9d6700f tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Created reservations ['aaddcd0a-7ab3-427b-a24c-5fb85b189ba2', '4a2e4bfa-0b0b-4ec0-b55d-0fd64068044b', 'abb9fb27-f9e2-4927-a99a-d3cfdbc5098e', '33405d1f-e233-426f-903a-f72d91091c28'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:07:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cd1f789e-38c2-478c-a0e9-fb34f9d6700f tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:07:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cd1f789e-38c2-478c-a0e9-fb34f9d6700f tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:07:19 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cd1f789e-38c2-478c-a0e9-fb34f9d6700f tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:07:19 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cd1f789e-38c2-478c-a0e9-fb34f9d6700f tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:07:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cd1f789e-38c2-478c-a0e9-fb34f9d6700f tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:07:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cd1f789e-38c2-478c-a0e9-fb34f9d6700f tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:19 devstack sudo[113668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:07:19 devstack sudo[113668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:19 devstack sudo[113668]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cd1f789e-38c2-478c-a0e9-fb34f9d6700f tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.667s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:19 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-cd1f789e-38c2-478c-a0e9-fb34f9d6700f tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:07:19 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-cd1f789e-38c2-478c-a0e9-fb34f9d6700f tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Deleted volume successfully. Jun 24 10:07:19 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-cd1f789e-38c2-478c-a0e9-fb34f9d6700f tempest-TestServerVolumeAttachScenarioOldVersion-2096086140 None] Lock "cinder-b62b5f30-70c4-47bf-b573-a7ac4a9fed62-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:07:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 10:07:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:07:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:07:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:07:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:07:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:07:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:25 devstack sudo[113716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:07:25 devstack sudo[113716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:25 devstack sudo[113716]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.625s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:07:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 10:07:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 28 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 10:07:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 10:07:29 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=13,cinder:INSERT=3,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 10:07:29 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:UPDATE=12,cinder:SELECT=14,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 10:07:38 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:07:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Flow 'volume_create_manager' (7f5ba191-f4fa-4882-ab91-354a300b4206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:07:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab93bcce-fe43-4766-ae92-2666106155de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab93bcce-fe43-4766-ae92-2666106155de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1600470055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3451d471-3b64-4c9b-8be5-98fa2d7adf72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69acfb5fbb974a858ba7c43b5657872b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:07:38Z,use_quota=True,user_id='5f8159bf4e9d4672aef7bf338b1355c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02de0c9f-a5c8-4501-bccf-06a96a74007b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02de0c9f-a5c8-4501-bccf-06a96a74007b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (041a02cb-4211-4ff6-a87f-fd271747fc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (041a02cb-4211-4ff6-a87f-fd271747fc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3451d471-3b64-4c9b-8be5-98fa2d7adf72', 'volume_name': 'volume-3451d471-3b64-4c9b-8be5-98fa2d7adf72', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2187dc-b1d9-4e77-8dcf-6cf8d60e218a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2187dc-b1d9-4e77-8dcf-6cf8d60e218a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:38 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d29455d-ab8a-4595-a262-5069369924d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:38 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Volume 3451d471-3b64-4c9b-8be5-98fa2d7adf72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3451d471-3b64-4c9b-8be5-98fa2d7adf72', 'volume_size': 1} Jun 24 10:07:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:07:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:07:38 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1600470055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3451d471-3b64-4c9b-8be5-98fa2d7adf72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69acfb5fbb974a858ba7c43b5657872b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:07:38Z,use_quota=True,user_id='5f8159bf4e9d4672aef7bf338b1355c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:07:38 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Creating volume 3451d471-3b64-4c9b-8be5-98fa2d7adf72 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:07:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:07:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:07:38 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:07:38 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:07:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:07:38 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:07:38 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:07:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3451d471-3b64-4c9b-8be5-98fa2d7adf72 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:38 devstack sudo[113761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3451d471-3b64-4c9b-8be5-98fa2d7adf72 1073741824 Jun 24 10:07:38 devstack sudo[113761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:38 devstack sudo[113761]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3451d471-3b64-4c9b-8be5-98fa2d7adf72 1073741824" returned: 0 in 0.772s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3451d471-3b64-4c9b-8be5-98fa2d7adf72 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:38 devstack sudo[113767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3451d471-3b64-4c9b-8be5-98fa2d7adf72 Jun 24 10:07:38 devstack sudo[113767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:39 devstack sudo[113767]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3451d471-3b64-4c9b-8be5-98fa2d7adf72" returned: 0 in 0.637s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:07:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:07:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d29455d-ab8a-4595-a262-5069369924d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3451d471-3b64-4c9b-8be5-98fa2d7adf72', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e72e564-4135-4594-8139-2b64696397b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:39 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Volume volume-3451d471-3b64-4c9b-8be5-98fa2d7adf72 (3451d471-3b64-4c9b-8be5-98fa2d7adf72): created successfully Jun 24 10:07:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e72e564-4135-4594-8139-2b64696397b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Flow 'volume_create_manager' (7f5ba191-f4fa-4882-ab91-354a300b4206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:07:39 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-f25ca54b-b728-4d76-94ab-de8faa8e0849 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Created volume successfully. Jun 24 10:07:40 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:07:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Flow 'volume_create_manager' (0d510e20-7bc7-441a-b821-037283d1f9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:07:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b2e188-37d5-47d7-9eb3-9c4d9a6be66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b2e188-37d5-47d7-9eb3-9c4d9a6be66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-651719921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58617da8-1e79-474d-bfc1-f94e2d11fd9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69acfb5fbb974a858ba7c43b5657872b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:07:40Z,use_quota=True,user_id='5f8159bf4e9d4672aef7bf338b1355c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49ce160-6019-4eb8-b152-90c67a795eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49ce160-6019-4eb8-b152-90c67a795eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b35ccfba-a2e6-4fcd-a7e6-3f1a8b308029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b35ccfba-a2e6-4fcd-a7e6-3f1a8b308029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58617da8-1e79-474d-bfc1-f94e2d11fd9c', 'volume_name': 'volume-58617da8-1e79-474d-bfc1-f94e2d11fd9c', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de6e63b-c704-4b29-a199-c2ff927fba32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de6e63b-c704-4b29-a199-c2ff927fba32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1718a9-87ef-4a72-9a9f-0cda2ed407db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:40 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Volume 58617da8-1e79-474d-bfc1-f94e2d11fd9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58617da8-1e79-474d-bfc1-f94e2d11fd9c', 'volume_size': 1} Jun 24 10:07:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:07:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:07:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-651719921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58617da8-1e79-474d-bfc1-f94e2d11fd9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69acfb5fbb974a858ba7c43b5657872b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:07:40Z,use_quota=True,user_id='5f8159bf4e9d4672aef7bf338b1355c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:07:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Creating volume 58617da8-1e79-474d-bfc1-f94e2d11fd9c {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:07:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:07:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:07:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:07:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:07:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:07:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:07:40 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:07:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58617da8-1e79-474d-bfc1-f94e2d11fd9c 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:40 devstack sudo[113770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58617da8-1e79-474d-bfc1-f94e2d11fd9c 1073741824 Jun 24 10:07:40 devstack sudo[113770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Flow 'volume_create_manager' (c33dbf05-8031-4634-b883-bee7aed61556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53209007-df94-4159-ab2e-61c318cc8177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53209007-df94-4159-ab2e-61c318cc8177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1482187410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebfbacf2-eda8-49fd-bceb-63ae86f5e293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69acfb5fbb974a858ba7c43b5657872b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:07:41Z,use_quota=True,user_id='5f8159bf4e9d4672aef7bf338b1355c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f97cd2-6a30-4e05-b341-5c4eb51f41fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f97cd2-6a30-4e05-b341-5c4eb51f41fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6774e1fb-81d8-4f4d-8ab7-fbbc3aaf8fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6774e1fb-81d8-4f4d-8ab7-fbbc3aaf8fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebfbacf2-eda8-49fd-bceb-63ae86f5e293', 'volume_name': 'volume-ebfbacf2-eda8-49fd-bceb-63ae86f5e293', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c07e502-a819-4803-8703-5ea40e90b0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c07e502-a819-4803-8703-5ea40e90b0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (036a73e3-15c6-499b-bae6-c057a6518011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:41 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Volume ebfbacf2-eda8-49fd-bceb-63ae86f5e293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebfbacf2-eda8-49fd-bceb-63ae86f5e293', 'volume_size': 1} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Flow 'volume_create_manager' (12930b8f-4333-45e5-8a07-d3c85daf9b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2708dd-3a74-4b1b-b6ed-0157da6252aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2708dd-3a74-4b1b-b6ed-0157da6252aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-807241390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69acfb5fbb974a858ba7c43b5657872b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:07:41Z,use_quota=True,user_id='5f8159bf4e9d4672aef7bf338b1355c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b241f4cf-c9c2-4944-a65c-21f31a4ee81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b241f4cf-c9c2-4944-a65c-21f31a4ee81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0291af81-00e2-4b03-bd2d-4c94adb91eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0291af81-00e2-4b03-bd2d-4c94adb91eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0', 'volume_name': 'volume-adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e42a57-2737-4010-b774-3a1fcb30857c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e42a57-2737-4010-b774-3a1fcb30857c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b21fa3-a8f3-409d-aed8-3ad018eb413d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:41 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Volume adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0', 'volume_size': 1} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:07:41 devstack sudo[113770]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58617da8-1e79-474d-bfc1-f94e2d11fd9c 1073741824" returned: 0 in 0.904s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58617da8-1e79-474d-bfc1-f94e2d11fd9c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:41 devstack sudo[113776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58617da8-1e79-474d-bfc1-f94e2d11fd9c Jun 24 10:07:41 devstack sudo[113776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Flow 'volume_create_manager' (f243047d-5d11-40a8-b6e6-a98e648c2f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62d19f6-226f-4931-bee3-7fd8da00527d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e62d19f6-226f-4931-bee3-7fd8da00527d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1315722062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a651c4a-6aa9-4599-952d-fd8703c846a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69acfb5fbb974a858ba7c43b5657872b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:07:42Z,use_quota=True,user_id='5f8159bf4e9d4672aef7bf338b1355c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c648c64e-37f5-4ec0-9dfa-555b51a7ae93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c648c64e-37f5-4ec0-9dfa-555b51a7ae93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (745dc095-780b-44a3-bf8c-76d227d7c6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (745dc095-780b-44a3-bf8c-76d227d7c6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a651c4a-6aa9-4599-952d-fd8703c846a5', 'volume_name': 'volume-8a651c4a-6aa9-4599-952d-fd8703c846a5', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf8c552d-3819-4a7d-a053-af4cfeb7a827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf8c552d-3819-4a7d-a053-af4cfeb7a827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7264e05a-1fb3-4157-8e78-390c94893a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:41 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Volume 8a651c4a-6aa9-4599-952d-fd8703c846a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a651c4a-6aa9-4599-952d-fd8703c846a5', 'volume_size': 1} Jun 24 10:07:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Flow 'volume_create_manager' (d0e7b801-37d1-4b5d-b422-ff4d6b33822e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02c7f7f-eb21-4ea3-b8b3-44d7a5628d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02c7f7f-eb21-4ea3-b8b3-44d7a5628d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2053990228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=514ca39f-3728-4ee4-a64c-4efacb473073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69acfb5fbb974a858ba7c43b5657872b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:07:42Z,use_quota=True,user_id='5f8159bf4e9d4672aef7bf338b1355c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d65b79d-a315-41dd-a971-1d4be2cd69fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d65b79d-a315-41dd-a971-1d4be2cd69fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f450aaad-6935-4e00-b2e3-6cc387b1cc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f450aaad-6935-4e00-b2e3-6cc387b1cc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '514ca39f-3728-4ee4-a64c-4efacb473073', 'volume_name': 'volume-514ca39f-3728-4ee4-a64c-4efacb473073', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb1d0e6-9b4a-46da-91df-ca83c77c9a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb1d0e6-9b4a-46da-91df-ca83c77c9a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1865f3d-103d-4488-b51b-95e0bdd53515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:42 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Volume 514ca39f-3728-4ee4-a64c-4efacb473073: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-514ca39f-3728-4ee4-a64c-4efacb473073', 'volume_size': 1} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:07:42 devstack sudo[113776]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58617da8-1e79-474d-bfc1-f94e2d11fd9c" returned: 0 in 0.718s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.152s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1482187410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebfbacf2-eda8-49fd-bceb-63ae86f5e293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69acfb5fbb974a858ba7c43b5657872b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:07:41Z,use_quota=True,user_id='5f8159bf4e9d4672aef7bf338b1355c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Creating volume ebfbacf2-eda8-49fd-bceb-63ae86f5e293 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:07:42 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ebfbacf2-eda8-49fd-bceb-63ae86f5e293 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1718a9-87ef-4a72-9a9f-0cda2ed407db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58617da8-1e79-474d-bfc1-f94e2d11fd9c', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9720ad58-4540-4127-9348-c62a7fcab893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:42 devstack sudo[113780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ebfbacf2-eda8-49fd-bceb-63ae86f5e293 1073741824 Jun 24 10:07:42 devstack sudo[113780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:42 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Volume volume-58617da8-1e79-474d-bfc1-f94e2d11fd9c (58617da8-1e79-474d-bfc1-f94e2d11fd9c): created successfully Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9720ad58-4540-4127-9348-c62a7fcab893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Flow 'volume_create_manager' (0d510e20-7bc7-441a-b821-037283d1f9ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:07:42 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-6525ed83-aed7-47dc-aeca-09587b5da62c tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Created volume successfully. Jun 24 10:07:43 devstack sudo[113780]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ebfbacf2-eda8-49fd-bceb-63ae86f5e293 1073741824" returned: 0 in 0.790s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ebfbacf2-eda8-49fd-bceb-63ae86f5e293 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:43 devstack sudo[113786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ebfbacf2-eda8-49fd-bceb-63ae86f5e293 Jun 24 10:07:43 devstack sudo[113786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:43 devstack sudo[113786]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ebfbacf2-eda8-49fd-bceb-63ae86f5e293" returned: 0 in 0.625s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:43 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:07:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:07:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.256s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:07:43 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-807241390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69acfb5fbb974a858ba7c43b5657872b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:07:41Z,use_quota=True,user_id='5f8159bf4e9d4672aef7bf338b1355c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:07:43 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Creating volume adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:07:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:07:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:07:43 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:07:43 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:07:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:07:43 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:07:43 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:07:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:43 devstack sudo[113789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0 1073741824 Jun 24 10:07:43 devstack sudo[113789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (036a73e3-15c6-499b-bae6-c057a6518011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebfbacf2-eda8-49fd-bceb-63ae86f5e293', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66991f4d-0443-45f9-b3a0-c914c5b84615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:43 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Volume volume-ebfbacf2-eda8-49fd-bceb-63ae86f5e293 (ebfbacf2-eda8-49fd-bceb-63ae86f5e293): created successfully Jun 24 10:07:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66991f4d-0443-45f9-b3a0-c914c5b84615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:43 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Flow 'volume_create_manager' (c33dbf05-8031-4634-b883-bee7aed61556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:07:43 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-62eb701a-b1fc-4b6b-aac2-5600a1269db7 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Created volume successfully. Jun 24 10:07:44 devstack sudo[113789]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0 1073741824" returned: 0 in 0.797s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:44 devstack sudo[113794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0 Jun 24 10:07:44 devstack sudo[113794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:45 devstack sudo[113794]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0" returned: 0 in 0.626s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:45 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:07:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:07:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.358s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:07:45 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1315722062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a651c4a-6aa9-4599-952d-fd8703c846a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69acfb5fbb974a858ba7c43b5657872b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:07:42Z,use_quota=True,user_id='5f8159bf4e9d4672aef7bf338b1355c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:07:45 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Creating volume 8a651c4a-6aa9-4599-952d-fd8703c846a5 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:07:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:07:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:07:45 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:07:45 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:07:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:07:45 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:07:45 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:07:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8a651c4a-6aa9-4599-952d-fd8703c846a5 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b21fa3-a8f3-409d-aed8-3ad018eb413d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:45 devstack sudo[113797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8a651c4a-6aa9-4599-952d-fd8703c846a5 1073741824 Jun 24 10:07:45 devstack sudo[113797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f42a5a1-9663-4570-8c89-fa968ec7ab39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:45 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Volume volume-adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0 (adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0): created successfully Jun 24 10:07:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f42a5a1-9663-4570-8c89-fa968ec7ab39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Flow 'volume_create_manager' (12930b8f-4333-45e5-8a07-d3c85daf9b4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:07:45 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-34288403-9760-4547-9d94-c213aac7c920 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Created volume successfully. Jun 24 10:07:45 devstack sudo[113797]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8a651c4a-6aa9-4599-952d-fd8703c846a5 1073741824" returned: 0 in 0.771s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8a651c4a-6aa9-4599-952d-fd8703c846a5 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:46 devstack sudo[113802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8a651c4a-6aa9-4599-952d-fd8703c846a5 Jun 24 10:07:46 devstack sudo[113802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:46 devstack sudo[113802]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8a651c4a-6aa9-4599-952d-fd8703c846a5" returned: 0 in 0.616s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:07:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:07:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.508s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:07:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2053990228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=514ca39f-3728-4ee4-a64c-4efacb473073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69acfb5fbb974a858ba7c43b5657872b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:07:42Z,use_quota=True,user_id='5f8159bf4e9d4672aef7bf338b1355c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:07:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Creating volume 514ca39f-3728-4ee4-a64c-4efacb473073 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:07:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:07:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:07:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:07:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:07:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:07:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:07:46 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:07:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-514ca39f-3728-4ee4-a64c-4efacb473073 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7264e05a-1fb3-4157-8e78-390c94893a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a651c4a-6aa9-4599-952d-fd8703c846a5', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:46 devstack sudo[113805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-514ca39f-3728-4ee4-a64c-4efacb473073 1073741824 Jun 24 10:07:46 devstack sudo[113805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3100cc75-a6c0-40af-9f59-c8c8405c8f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:46 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Volume volume-8a651c4a-6aa9-4599-952d-fd8703c846a5 (8a651c4a-6aa9-4599-952d-fd8703c846a5): created successfully Jun 24 10:07:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3100cc75-a6c0-40af-9f59-c8c8405c8f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Flow 'volume_create_manager' (f243047d-5d11-40a8-b6e6-a98e648c2f14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:07:46 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-0dc271dd-65d8-42e8-8f2b-7f714b90d1f3 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Created volume successfully. Jun 24 10:07:47 devstack sudo[113805]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-514ca39f-3728-4ee4-a64c-4efacb473073 1073741824" returned: 0 in 0.810s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-514ca39f-3728-4ee4-a64c-4efacb473073 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:47 devstack sudo[113811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-514ca39f-3728-4ee4-a64c-4efacb473073 Jun 24 10:07:47 devstack sudo[113811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:48 devstack sudo[113811]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-514ca39f-3728-4ee4-a64c-4efacb473073" returned: 0 in 0.639s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:48 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:07:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:07:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1865f3d-103d-4488-b51b-95e0bdd53515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-514ca39f-3728-4ee4-a64c-4efacb473073', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb735ef1-a104-4557-a9a8-9744ac6b4d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:07:48 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Volume volume-514ca39f-3728-4ee4-a64c-4efacb473073 (514ca39f-3728-4ee4-a64c-4efacb473073): created successfully Jun 24 10:07:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb735ef1-a104-4557-a9a8-9744ac6b4d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:07:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Flow 'volume_create_manager' (d0e7b801-37d1-4b5d-b422-ff4d6b33822e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:07:48 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-559c993b-e14e-4098-9a9a-56138470b76f tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Created volume successfully. Jun 24 10:07:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5a4a46e4-d8f2-4135-8128-4ee2bc91c6f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "cinder-514ca39f-3728-4ee4-a64c-4efacb473073-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:07:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5a4a46e4-d8f2-4135-8128-4ee2bc91c6f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "cinder-514ca39f-3728-4ee4-a64c-4efacb473073-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:07:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5a4a46e4-d8f2-4135-8128-4ee2bc91c6f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "cinder-quobyte-514ca39f-3728-4ee4-a64c-4efacb473073" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:07:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5a4a46e4-d8f2-4135-8128-4ee2bc91c6f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "cinder-quobyte-514ca39f-3728-4ee4-a64c-4efacb473073" acquired by "delete_volume" :: waited 0.014s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:07:48 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0e7460-edb7-4ef7-88c7-d04b22a558a9]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:07:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5a4a46e4-d8f2-4135-8128-4ee2bc91c6f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-514ca39f-3728-4ee4-a64c-4efacb473073 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:48 devstack sudo[113814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-514ca39f-3728-4ee4-a64c-4efacb473073 Jun 24 10:07:48 devstack sudo[113814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:49 devstack sudo[113814]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5a4a46e4-d8f2-4135-8128-4ee2bc91c6f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-514ca39f-3728-4ee4-a64c-4efacb473073" returned: 0 in 0.747s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5a4a46e4-d8f2-4135-8128-4ee2bc91c6f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-514ca39f-3728-4ee4-a64c-4efacb473073 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:49 devstack sudo[113821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-514ca39f-3728-4ee4-a64c-4efacb473073 Jun 24 10:07:49 devstack sudo[113821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:50 devstack sudo[113821]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5a4a46e4-d8f2-4135-8128-4ee2bc91c6f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-514ca39f-3728-4ee4-a64c-4efacb473073" returned: 0 in 0.623s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5a4a46e4-d8f2-4135-8128-4ee2bc91c6f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "cinder-quobyte-514ca39f-3728-4ee4-a64c-4efacb473073" released by "delete_volume" :: held 1.408s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:07:50 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-5a4a46e4-d8f2-4135-8128-4ee2bc91c6f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Created reservations ['304af755-6ae4-48a1-9885-73d17912496c', 'c5019a32-f599-44bd-91e4-6773bb3ec36d', '536216d5-6530-447a-8900-8da45a1e7797', 'a52bd1e2-f631-49e0-84ca-183c8f7e2209'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:07:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5a4a46e4-d8f2-4135-8128-4ee2bc91c6f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:07:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5a4a46e4-d8f2-4135-8128-4ee2bc91c6f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:07:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-5a4a46e4-d8f2-4135-8128-4ee2bc91c6f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:07:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-5a4a46e4-d8f2-4135-8128-4ee2bc91c6f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:07:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5a4a46e4-d8f2-4135-8128-4ee2bc91c6f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:07:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5a4a46e4-d8f2-4135-8128-4ee2bc91c6f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:50 devstack sudo[113824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:07:50 devstack sudo[113824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d6e4cb4e-d768-4ee3-b54a-c02b9525ce64 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "cinder-8a651c4a-6aa9-4599-952d-fd8703c846a5-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:07:50 devstack sudo[113824]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5a4a46e4-d8f2-4135-8128-4ee2bc91c6f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.663s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:50 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-5a4a46e4-d8f2-4135-8128-4ee2bc91c6f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:07:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d6e4cb4e-d768-4ee3-b54a-c02b9525ce64 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "cinder-8a651c4a-6aa9-4599-952d-fd8703c846a5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:07:50 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-5a4a46e4-d8f2-4135-8128-4ee2bc91c6f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Deleted volume successfully. Jun 24 10:07:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5a4a46e4-d8f2-4135-8128-4ee2bc91c6f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "cinder-514ca39f-3728-4ee4-a64c-4efacb473073-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:07:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d6e4cb4e-d768-4ee3-b54a-c02b9525ce64 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "cinder-quobyte-8a651c4a-6aa9-4599-952d-fd8703c846a5" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:07:50 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d6e4cb4e-d768-4ee3-b54a-c02b9525ce64 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "cinder-quobyte-8a651c4a-6aa9-4599-952d-fd8703c846a5" acquired by "delete_volume" :: waited 0.012s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:07:50 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[471bd536-36ba-481a-81ac-771460c61150]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:07:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d6e4cb4e-d768-4ee3-b54a-c02b9525ce64 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8a651c4a-6aa9-4599-952d-fd8703c846a5 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:50 devstack sudo[113827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8a651c4a-6aa9-4599-952d-fd8703c846a5 Jun 24 10:07:50 devstack sudo[113827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:51 devstack sudo[113827]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d6e4cb4e-d768-4ee3-b54a-c02b9525ce64 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8a651c4a-6aa9-4599-952d-fd8703c846a5" returned: 0 in 0.760s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d6e4cb4e-d768-4ee3-b54a-c02b9525ce64 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8a651c4a-6aa9-4599-952d-fd8703c846a5 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:51 devstack sudo[113833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8a651c4a-6aa9-4599-952d-fd8703c846a5 Jun 24 10:07:51 devstack sudo[113833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:52 devstack sudo[113833]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d6e4cb4e-d768-4ee3-b54a-c02b9525ce64 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8a651c4a-6aa9-4599-952d-fd8703c846a5" returned: 0 in 0.654s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:52 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d6e4cb4e-d768-4ee3-b54a-c02b9525ce64 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "cinder-quobyte-8a651c4a-6aa9-4599-952d-fd8703c846a5" released by "delete_volume" :: held 1.450s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:07:52 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-d6e4cb4e-d768-4ee3-b54a-c02b9525ce64 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Created reservations ['6c63196f-54e8-4aed-af36-03b35977bb32', '8fd1873c-0818-4d07-8a82-2f140f38fc01', '5f1c87f4-0957-4869-a501-6604241e8691', '33827b09-f3d6-412b-bc95-89224995202e'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:07:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d6e4cb4e-d768-4ee3-b54a-c02b9525ce64 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:07:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d6e4cb4e-d768-4ee3-b54a-c02b9525ce64 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:07:52 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d6e4cb4e-d768-4ee3-b54a-c02b9525ce64 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:07:52 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d6e4cb4e-d768-4ee3-b54a-c02b9525ce64 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:07:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d6e4cb4e-d768-4ee3-b54a-c02b9525ce64 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:07:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d6e4cb4e-d768-4ee3-b54a-c02b9525ce64 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:52 devstack sudo[113837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:07:52 devstack sudo[113837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:52 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-749c6c57-035f-472c-9e1c-d7e147f75354 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "cinder-adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:07:53 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-749c6c57-035f-472c-9e1c-d7e147f75354 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "cinder-adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:07:53 devstack sudo[113837]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:53 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-749c6c57-035f-472c-9e1c-d7e147f75354 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "cinder-quobyte-adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:07:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d6e4cb4e-d768-4ee3-b54a-c02b9525ce64 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.652s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:53 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-d6e4cb4e-d768-4ee3-b54a-c02b9525ce64 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:07:53 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-d6e4cb4e-d768-4ee3-b54a-c02b9525ce64 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Deleted volume successfully. Jun 24 10:07:53 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-749c6c57-035f-472c-9e1c-d7e147f75354 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "cinder-quobyte-adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0" acquired by "delete_volume" :: waited 0.027s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:07:53 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d6e4cb4e-d768-4ee3-b54a-c02b9525ce64 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "cinder-8a651c4a-6aa9-4599-952d-fd8703c846a5-delete_volume" released by "delete_volume" :: held 2.316s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:07:53 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c749b80-b28e-40b6-8245-c8201c9acf66]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:07:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-749c6c57-035f-472c-9e1c-d7e147f75354 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:53 devstack sudo[113840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0 Jun 24 10:07:53 devstack sudo[113840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:53 devstack sudo[113840]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-749c6c57-035f-472c-9e1c-d7e147f75354 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0" returned: 0 in 0.740s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-749c6c57-035f-472c-9e1c-d7e147f75354 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:53 devstack sudo[113846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0 Jun 24 10:07:53 devstack sudo[113846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:54 devstack sudo[113846]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-749c6c57-035f-472c-9e1c-d7e147f75354 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0" returned: 0 in 0.631s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:54 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-749c6c57-035f-472c-9e1c-d7e147f75354 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "cinder-quobyte-adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0" released by "delete_volume" :: held 1.417s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:07:54 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-749c6c57-035f-472c-9e1c-d7e147f75354 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Created reservations ['f02486b7-08f8-4a45-bd0f-46de018ba06b', '030bf023-b485-4bca-af80-d976f923588b', '97272422-6c3b-47b7-afeb-7748e52b5a98', '80dbb344-1c53-4922-9c0f-45f745ccc22d'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:07:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-749c6c57-035f-472c-9e1c-d7e147f75354 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:07:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-749c6c57-035f-472c-9e1c-d7e147f75354 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:07:54 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-749c6c57-035f-472c-9e1c-d7e147f75354 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:07:54 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-749c6c57-035f-472c-9e1c-d7e147f75354 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:07:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-749c6c57-035f-472c-9e1c-d7e147f75354 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:07:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-749c6c57-035f-472c-9e1c-d7e147f75354 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:54 devstack sudo[113851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:07:54 devstack sudo[113851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:55 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d8e2e091-e682-4de4-be12-f2576c42049a tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "cinder-ebfbacf2-eda8-49fd-bceb-63ae86f5e293-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:07:55 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d8e2e091-e682-4de4-be12-f2576c42049a tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "cinder-ebfbacf2-eda8-49fd-bceb-63ae86f5e293-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:07:55 devstack sudo[113851]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-749c6c57-035f-472c-9e1c-d7e147f75354 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.654s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:55 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-749c6c57-035f-472c-9e1c-d7e147f75354 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:07:55 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-749c6c57-035f-472c-9e1c-d7e147f75354 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Deleted volume successfully. Jun 24 10:07:55 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-749c6c57-035f-472c-9e1c-d7e147f75354 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "cinder-adf4dc71-f1e1-4dcd-b21f-d41ca9472fb0-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:07:55 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d8e2e091-e682-4de4-be12-f2576c42049a tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "cinder-quobyte-ebfbacf2-eda8-49fd-bceb-63ae86f5e293" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:07:55 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d8e2e091-e682-4de4-be12-f2576c42049a tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "cinder-quobyte-ebfbacf2-eda8-49fd-bceb-63ae86f5e293" acquired by "delete_volume" :: waited 0.015s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:07:55 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d82ee15-36f8-4b7d-a453-58aac3cfcafd]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:07:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d8e2e091-e682-4de4-be12-f2576c42049a tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ebfbacf2-eda8-49fd-bceb-63ae86f5e293 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:55 devstack sudo[113854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ebfbacf2-eda8-49fd-bceb-63ae86f5e293 Jun 24 10:07:55 devstack sudo[113854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:56 devstack sudo[113854]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d8e2e091-e682-4de4-be12-f2576c42049a tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ebfbacf2-eda8-49fd-bceb-63ae86f5e293" returned: 0 in 0.738s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d8e2e091-e682-4de4-be12-f2576c42049a tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ebfbacf2-eda8-49fd-bceb-63ae86f5e293 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:56 devstack sudo[113859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ebfbacf2-eda8-49fd-bceb-63ae86f5e293 Jun 24 10:07:56 devstack sudo[113859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:56 devstack sudo[113859]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d8e2e091-e682-4de4-be12-f2576c42049a tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ebfbacf2-eda8-49fd-bceb-63ae86f5e293" returned: 0 in 0.635s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:56 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d8e2e091-e682-4de4-be12-f2576c42049a tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "cinder-quobyte-ebfbacf2-eda8-49fd-bceb-63ae86f5e293" released by "delete_volume" :: held 1.416s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:07:56 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-d8e2e091-e682-4de4-be12-f2576c42049a tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Created reservations ['9114552a-8dce-42f4-a805-bd8a56005e37', '3966b191-fa10-4c73-8de1-2093b4f964cb', 'd6075d88-d7de-4807-be3e-c688f4630978', '606fac0c-03ea-4ebf-af06-2f656bc27d79'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:07:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d8e2e091-e682-4de4-be12-f2576c42049a tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:07:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d8e2e091-e682-4de4-be12-f2576c42049a tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:07:56 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d8e2e091-e682-4de4-be12-f2576c42049a tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:07:56 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d8e2e091-e682-4de4-be12-f2576c42049a tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:07:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d8e2e091-e682-4de4-be12-f2576c42049a tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:07:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d8e2e091-e682-4de4-be12-f2576c42049a tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:56 devstack sudo[113862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:07:56 devstack sudo[113862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:57 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7a304226-e784-4125-8b49-8f0ba886f3f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "cinder-58617da8-1e79-474d-bfc1-f94e2d11fd9c-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:07:57 devstack sudo[113862]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d8e2e091-e682-4de4-be12-f2576c42049a tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.635s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:57 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-d8e2e091-e682-4de4-be12-f2576c42049a tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:07:57 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7a304226-e784-4125-8b49-8f0ba886f3f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "cinder-58617da8-1e79-474d-bfc1-f94e2d11fd9c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:07:57 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-d8e2e091-e682-4de4-be12-f2576c42049a tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Deleted volume successfully. Jun 24 10:07:57 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d8e2e091-e682-4de4-be12-f2576c42049a tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "cinder-ebfbacf2-eda8-49fd-bceb-63ae86f5e293-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:07:57 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7a304226-e784-4125-8b49-8f0ba886f3f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "cinder-quobyte-58617da8-1e79-474d-bfc1-f94e2d11fd9c" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:07:57 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7a304226-e784-4125-8b49-8f0ba886f3f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "cinder-quobyte-58617da8-1e79-474d-bfc1-f94e2d11fd9c" acquired by "delete_volume" :: waited 0.015s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:07:57 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e21f6d7-7356-4d75-b7ce-59ee0b025386]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:07:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7a304226-e784-4125-8b49-8f0ba886f3f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58617da8-1e79-474d-bfc1-f94e2d11fd9c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:57 devstack sudo[113865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58617da8-1e79-474d-bfc1-f94e2d11fd9c Jun 24 10:07:57 devstack sudo[113865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:58 devstack sudo[113865]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7a304226-e784-4125-8b49-8f0ba886f3f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58617da8-1e79-474d-bfc1-f94e2d11fd9c" returned: 0 in 0.779s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7a304226-e784-4125-8b49-8f0ba886f3f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58617da8-1e79-474d-bfc1-f94e2d11fd9c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:58 devstack sudo[113870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58617da8-1e79-474d-bfc1-f94e2d11fd9c Jun 24 10:07:58 devstack sudo[113870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:58 devstack sudo[113870]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7a304226-e784-4125-8b49-8f0ba886f3f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-58617da8-1e79-474d-bfc1-f94e2d11fd9c" returned: 0 in 0.626s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:58 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7a304226-e784-4125-8b49-8f0ba886f3f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "cinder-quobyte-58617da8-1e79-474d-bfc1-f94e2d11fd9c" released by "delete_volume" :: held 1.445s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:07:59 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-7a304226-e784-4125-8b49-8f0ba886f3f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Created reservations ['c6595710-4151-4e8c-ac8c-58003552a421', '77d05d8a-eb41-473f-a4ec-61a44e71f21e', '4c842b31-0603-4d60-9250-5842ba5f038d', '68daa9e8-bb3d-4fb2-a249-c64e2057d0fd'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:07:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7a304226-e784-4125-8b49-8f0ba886f3f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:07:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7a304226-e784-4125-8b49-8f0ba886f3f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:07:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7a304226-e784-4125-8b49-8f0ba886f3f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:07:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7a304226-e784-4125-8b49-8f0ba886f3f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:07:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7a304226-e784-4125-8b49-8f0ba886f3f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:07:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7a304226-e784-4125-8b49-8f0ba886f3f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:59 devstack sudo[113873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:07:59 devstack sudo[113873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:07:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7e2107d0-7320-484f-bbd5-654f32acf557 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "cinder-3451d471-3b64-4c9b-8be5-98fa2d7adf72-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:07:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7e2107d0-7320-484f-bbd5-654f32acf557 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "cinder-3451d471-3b64-4c9b-8be5-98fa2d7adf72-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:07:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7e2107d0-7320-484f-bbd5-654f32acf557 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "cinder-quobyte-3451d471-3b64-4c9b-8be5-98fa2d7adf72" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:07:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7e2107d0-7320-484f-bbd5-654f32acf557 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "cinder-quobyte-3451d471-3b64-4c9b-8be5-98fa2d7adf72" acquired by "delete_volume" :: waited 0.019s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:07:59 devstack sudo[113873]: pam_unix(sudo:session): session closed for user root Jun 24 10:07:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7a304226-e784-4125-8b49-8f0ba886f3f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.691s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:07:59 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-7a304226-e784-4125-8b49-8f0ba886f3f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:07:59 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-7a304226-e784-4125-8b49-8f0ba886f3f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Deleted volume successfully. Jun 24 10:07:59 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcce1067-935a-4c9c-ac27-98985290d41c]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:07:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7e2107d0-7320-484f-bbd5-654f32acf557 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3451d471-3b64-4c9b-8be5-98fa2d7adf72 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:07:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7a304226-e784-4125-8b49-8f0ba886f3f0 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "cinder-58617da8-1e79-474d-bfc1-f94e2d11fd9c-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:07:59 devstack sudo[113876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3451d471-3b64-4c9b-8be5-98fa2d7adf72 Jun 24 10:07:59 devstack sudo[113876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:00 devstack sudo[113876]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7e2107d0-7320-484f-bbd5-654f32acf557 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3451d471-3b64-4c9b-8be5-98fa2d7adf72" returned: 0 in 0.750s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7e2107d0-7320-484f-bbd5-654f32acf557 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3451d471-3b64-4c9b-8be5-98fa2d7adf72 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:00 devstack sudo[113881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3451d471-3b64-4c9b-8be5-98fa2d7adf72 Jun 24 10:08:00 devstack sudo[113881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:01 devstack sudo[113881]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7e2107d0-7320-484f-bbd5-654f32acf557 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3451d471-3b64-4c9b-8be5-98fa2d7adf72" returned: 0 in 0.695s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:01 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7e2107d0-7320-484f-bbd5-654f32acf557 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "cinder-quobyte-3451d471-3b64-4c9b-8be5-98fa2d7adf72" released by "delete_volume" :: held 1.495s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:08:01 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-7e2107d0-7320-484f-bbd5-654f32acf557 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Created reservations ['16aca2ff-f4e9-48bd-9680-c9d4518e368b', 'd14ff878-cf3e-4e83-802b-3a94609c28a8', '717e91e3-cc49-47bb-a153-a6b83f8bdb16', 'be5744fd-9a45-477f-940c-abd50c4a9920'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:08:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7e2107d0-7320-484f-bbd5-654f32acf557 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7e2107d0-7320-484f-bbd5-654f32acf557 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:01 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7e2107d0-7320-484f-bbd5-654f32acf557 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:08:01 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7e2107d0-7320-484f-bbd5-654f32acf557 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:08:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7e2107d0-7320-484f-bbd5-654f32acf557 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7e2107d0-7320-484f-bbd5-654f32acf557 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:01 devstack sudo[113885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:08:01 devstack sudo[113885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:02 devstack sudo[113885]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7e2107d0-7320-484f-bbd5-654f32acf557 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.638s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:02 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-7e2107d0-7320-484f-bbd5-654f32acf557 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:08:02 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-7e2107d0-7320-484f-bbd5-654f32acf557 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Deleted volume successfully. Jun 24 10:08:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-7e2107d0-7320-484f-bbd5-654f32acf557 tempest-CreateVolumesFromSourceVolumeTest-1693028180 None] Lock "cinder-3451d471-3b64-4c9b-8be5-98fa2d7adf72-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:08:04 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:08:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Flow 'volume_create_manager' (d3890824-f62a-4db8-a438-d2c412a63d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:08:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25964ba9-6b05-4d30-baad-71eebef56a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25964ba9-6b05-4d30-baad-71eebef56a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-256822764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18268b16-7730-47a0-8fba-61bf63b99ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30907272444f4b9a9537a237ce2a5bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:08:05Z,use_quota=True,user_id='937b67739c24470cb8c36dd8ee6af6bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b67436-7f30-4f09-976e-ad118b54f7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b67436-7f30-4f09-976e-ad118b54f7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (925f747e-ee2a-4dbf-8f39-157ed3c78871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (925f747e-ee2a-4dbf-8f39-157ed3c78871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18268b16-7730-47a0-8fba-61bf63b99ff4', 'volume_name': 'volume-18268b16-7730-47a0-8fba-61bf63b99ff4', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1989f78-a689-400c-9236-cca68a634896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1989f78-a689-400c-9236-cca68a634896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:04 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b3a9272-7788-43f9-96d6-b5fb6b1775eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:04 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Volume 18268b16-7730-47a0-8fba-61bf63b99ff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18268b16-7730-47a0-8fba-61bf63b99ff4', 'volume_size': 1} Jun 24 10:08:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:04 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-256822764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18268b16-7730-47a0-8fba-61bf63b99ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30907272444f4b9a9537a237ce2a5bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:08:05Z,use_quota=True,user_id='937b67739c24470cb8c36dd8ee6af6bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:08:04 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Creating volume 18268b16-7730-47a0-8fba-61bf63b99ff4 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:08:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:04 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:08:04 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:08:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:04 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:08:04 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:08:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:04 devstack sudo[113895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4 1073741824 Jun 24 10:08:04 devstack sudo[113895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:05 devstack sudo[113895]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4 1073741824" returned: 0 in 0.778s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:05 devstack sudo[113900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4 Jun 24 10:08:05 devstack sudo[113900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:06 devstack sudo[113900]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4" returned: 0 in 0.615s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:06 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:08:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:06 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b3a9272-7788-43f9-96d6-b5fb6b1775eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18268b16-7730-47a0-8fba-61bf63b99ff4', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:06 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e75dc5ba-7291-4500-b8b1-91837781bf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:06 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Volume volume-18268b16-7730-47a0-8fba-61bf63b99ff4 (18268b16-7730-47a0-8fba-61bf63b99ff4): created successfully Jun 24 10:08:06 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e75dc5ba-7291-4500-b8b1-91837781bf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:06 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Flow 'volume_create_manager' (d3890824-f62a-4db8-a438-d2c412a63d5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:08:06 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-a8fa3ddb-2cfd-4722-b9bc-99d6d426feac tempest-VolumeDependencyTests-206044551 None] Created volume successfully. Jun 24 10:08:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-61236139-218d-4c02-98e3-b1559f918232 tempest-VolumeDependencyTests-206044551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-61236139-218d-4c02-98e3-b1559f918232 tempest-VolumeDependencyTests-206044551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:06 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-61236139-218d-4c02-98e3-b1559f918232 tempest-VolumeDependencyTests-206044551 None] Creating offline snapshot d65df9f4-b5aa-4911-a276-038604552ab8 of volume 18268b16-7730-47a0-8fba-61bf63b99ff4 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 10:08:06 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d29eba-6c35-4523-92ce-95b9613961bc]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:08:06 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-61236139-218d-4c02-98e3-b1559f918232 tempest-VolumeDependencyTests-206044551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:06 devstack sudo[113903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4 Jun 24 10:08:06 devstack sudo[113903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:07 devstack sudo[113903]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-61236139-218d-4c02-98e3-b1559f918232 tempest-VolumeDependencyTests-206044551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4" returned: 0 in 0.761s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-61236139-218d-4c02-98e3-b1559f918232 tempest-VolumeDependencyTests-206044551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.d65df9f4-b5aa-4911-a276-038604552ab8 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:07 devstack sudo[113908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.d65df9f4-b5aa-4911-a276-038604552ab8 1G Jun 24 10:08:07 devstack sudo[113908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:08 devstack sudo[113908]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-61236139-218d-4c02-98e3-b1559f918232 tempest-VolumeDependencyTests-206044551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.d65df9f4-b5aa-4911-a276-038604552ab8 1G" returned: 0 in 0.761s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-61236139-218d-4c02-98e3-b1559f918232 tempest-VolumeDependencyTests-206044551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18268b16-7730-47a0-8fba-61bf63b99ff4 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.d65df9f4-b5aa-4911-a276-038604552ab8 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:08 devstack sudo[113914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18268b16-7730-47a0-8fba-61bf63b99ff4 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.d65df9f4-b5aa-4911-a276-038604552ab8 Jun 24 10:08:08 devstack sudo[113914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:09 devstack sudo[113914]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-61236139-218d-4c02-98e3-b1559f918232 tempest-VolumeDependencyTests-206044551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18268b16-7730-47a0-8fba-61bf63b99ff4 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.d65df9f4-b5aa-4911-a276-038604552ab8" returned: 0 in 0.662s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:09 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-61236139-218d-4c02-98e3-b1559f918232 tempest-VolumeDependencyTests-206044551 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.d65df9f4-b5aa-4911-a276-038604552ab8 is being set with open permissions: ugo+rw Jun 24 10:08:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-61236139-218d-4c02-98e3-b1559f918232 tempest-VolumeDependencyTests-206044551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.d65df9f4-b5aa-4911-a276-038604552ab8 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:09 devstack sudo[113921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.d65df9f4-b5aa-4911-a276-038604552ab8 Jun 24 10:08:09 devstack sudo[113921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:09 devstack sudo[113921]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-61236139-218d-4c02-98e3-b1559f918232 tempest-VolumeDependencyTests-206044551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.d65df9f4-b5aa-4911-a276-038604552ab8" returned: 0 in 0.635s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-61236139-218d-4c02-98e3-b1559f918232 tempest-VolumeDependencyTests-206044551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:09 devstack sudo[113924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.info Jun 24 10:08:09 devstack sudo[113924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:10 devstack sudo[113924]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-61236139-218d-4c02-98e3-b1559f918232 tempest-VolumeDependencyTests-206044551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.info" returned: 0 in 0.632s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:10 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-61236139-218d-4c02-98e3-b1559f918232 tempest-VolumeDependencyTests-206044551 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.info is being set with open permissions: ugo+rw Jun 24 10:08:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-61236139-218d-4c02-98e3-b1559f918232 tempest-VolumeDependencyTests-206044551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:10 devstack sudo[113927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.info Jun 24 10:08:10 devstack sudo[113927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:10 devstack sudo[113927]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-61236139-218d-4c02-98e3-b1559f918232 tempest-VolumeDependencyTests-206044551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.info" returned: 0 in 0.619s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-61236139-218d-4c02-98e3-b1559f918232 tempest-VolumeDependencyTests-206044551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.148s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:11 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-61236139-218d-4c02-98e3-b1559f918232 tempest-VolumeDependencyTests-206044551 None] Create snapshot completed successfully Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Flow 'volume_create_manager' (7196014b-fcf2-4529-8348-40be238f4bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b9743c-48f3-4a60-a715-93b8fddecd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b9743c-48f3-4a60-a715-93b8fddecd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-706241526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e65c44-af8f-4477-9275-b21450e52ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30907272444f4b9a9537a237ce2a5bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d65df9f4-b5aa-4911-a276-038604552ab8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:08:12Z,use_quota=True,user_id='937b67739c24470cb8c36dd8ee6af6bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b2ee75-8add-4a8f-b119-534f01027833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b2ee75-8add-4a8f-b119-534f01027833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ccdeda-b3c1-4e61-b7a2-881cf920c39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ccdeda-b3c1-4e61-b7a2-881cf920c39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a4e65c44-af8f-4477-9275-b21450e52ae9', 'volume_name': 'volume-a4e65c44-af8f-4477-9275-b21450e52ae9', 'volume_size': 1, 'snapshot_id': 'd65df9f4-b5aa-4911-a276-038604552ab8'}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c2bc98-8646-4808-8ee5-baadc5b8cc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c2bc98-8646-4808-8ee5-baadc5b8cc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ce306d-a665-4d55-a7ca-93ad134deb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:12 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Volume a4e65c44-af8f-4477-9275-b21450e52ae9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a4e65c44-af8f-4477-9275-b21450e52ae9', 'volume_size': 1, 'snapshot_id': 'd65df9f4-b5aa-4911-a276-038604552ab8'} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Acquiring lock "cinder-quobyte-d65df9f4-b5aa-4911-a276-038604552ab8-a4e65c44-af8f-4477-9275-b21450e52ae9" by "_create_volume_from_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Lock "cinder-quobyte-d65df9f4-b5aa-4911-a276-038604552ab8-a4e65c44-af8f-4477-9275-b21450e52ae9" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Creating volume a4e65c44-af8f-4477-9275-b21450e52ae9 from snapshot d65df9f4-b5aa-4911-a276-038604552ab8 {{(pid=93447) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Acquiring lock "cinder-quobyte-a4e65c44-af8f-4477-9275-b21450e52ae9" by "_copy_volume_from_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Lock "cinder-quobyte-a4e65c44-af8f-4477-9275-b21450e52ae9" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] snapshot: d65df9f4-b5aa-4911-a276-038604552ab8, volume: a4e65c44-af8f-4477-9275-b21450e52ae9, {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b497fe81-6c29-49db-b1c7-8b2384ef4fa6]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:08:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.d65df9f4-b5aa-4911-a276-038604552ab8 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:12 devstack sudo[113931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.d65df9f4-b5aa-4911-a276-038604552ab8 Jun 24 10:08:12 devstack sudo[113931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:13 devstack sudo[113931]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.d65df9f4-b5aa-4911-a276-038604552ab8" returned: 0 in 0.739s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18268b16-7730-47a0-8fba-61bf63b99ff4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:08:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4 {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 10:08:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Creating direct copy from snapshot {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 10:08:13 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[22958deb-e62b-4802-85b7-d7ae5218ae7e]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:08:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:13 devstack sudo[113936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4 Jun 24 10:08:13 devstack sudo[113936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:14 devstack sudo[113936]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4" returned: 0 in 0.717s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:14 devstack cinder-volume[93447]: DEBUG cinder.utils [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Path /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a4e65c44-af8f-4477-9275-b21450e52ae9 not found in is_blk_device check {{(pid=93447) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 10:08:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a4e65c44-af8f-4477-9275-b21450e52ae9 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:14 devstack sudo[113941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a4e65c44-af8f-4477-9275-b21450e52ae9 Jun 24 10:08:14 devstack sudo[113941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:18 devstack sudo[113941]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a4e65c44-af8f-4477-9275-b21450e52ae9" returned: 0 in 4.222s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:18 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6b609d-d6b4-46ae-8b0d-35ce63a4c3f5]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:08:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:18 devstack sudo[113954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4 Jun 24 10:08:18 devstack sudo[113954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:19 devstack sudo[113954]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4" returned: 0 in 0.878s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:19 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4, size 1024.00 MB, duration 4.22 sec, destination /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a4e65c44-af8f-4477-9275-b21450e52ae9 {{(pid=93447) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 10:08:19 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Converted 1024.00 MB image at 242.48 MB/s Jun 24 10:08:19 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a4e65c44-af8f-4477-9275-b21450e52ae9 is being set with open permissions: ugo+rw Jun 24 10:08:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a4e65c44-af8f-4477-9275-b21450e52ae9 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:19 devstack sudo[113959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a4e65c44-af8f-4477-9275-b21450e52ae9 Jun 24 10:08:19 devstack sudo[113959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:19 devstack sudo[113959]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a4e65c44-af8f-4477-9275-b21450e52ae9" returned: 0 in 0.621s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:19 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Lock "cinder-quobyte-a4e65c44-af8f-4477-9275-b21450e52ae9" released by "_copy_volume_from_snapshot" :: held 7.262s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:08:19 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Lock "cinder-quobyte-d65df9f4-b5aa-4911-a276-038604552ab8-a4e65c44-af8f-4477-9275-b21450e52ae9" released by "_create_volume_from_snapshot" :: held 7.289s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:08:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.303s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ce306d-a665-4d55-a7ca-93ad134deb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4e65c44-af8f-4477-9275-b21450e52ae9', 'volume_size': 1, 'snapshot_id': 'd65df9f4-b5aa-4911-a276-038604552ab8'}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc487b68-7632-4ff7-90b0-310f0b021b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:19 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Volume volume-a4e65c44-af8f-4477-9275-b21450e52ae9 (a4e65c44-af8f-4477-9275-b21450e52ae9): created successfully Jun 24 10:08:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc487b68-7632-4ff7-90b0-310f0b021b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:19 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Flow 'volume_create_manager' (7196014b-fcf2-4529-8348-40be238f4bac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:08:19 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-0156335e-19b1-41d4-8c5c-9bd58948dca5 tempest-VolumeDependencyTests-206044551 None] Created volume successfully. Jun 24 10:08:20 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c51d244b-417a-4bc8-bc87-a01ada874198 tempest-VolumeDependencyTests-206044551 None] Acquiring lock "cinder-d65df9f4-b5aa-4911-a276-038604552ab8-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:08:20 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c51d244b-417a-4bc8-bc87-a01ada874198 tempest-VolumeDependencyTests-206044551 None] Lock "cinder-d65df9f4-b5aa-4911-a276-038604552ab8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:08:20 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c51d244b-417a-4bc8-bc87-a01ada874198 tempest-VolumeDependencyTests-206044551 None] Acquiring lock "cinder-quobyte-18268b16-7730-47a0-8fba-61bf63b99ff4" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:08:20 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c51d244b-417a-4bc8-bc87-a01ada874198 tempest-VolumeDependencyTests-206044551 None] Lock "cinder-quobyte-18268b16-7730-47a0-8fba-61bf63b99ff4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:08:20 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c51d244b-417a-4bc8-bc87-a01ada874198 tempest-VolumeDependencyTests-206044551 None] Acquiring lock "cinder-quobyte-d65df9f4-b5aa-4911-a276-038604552ab8" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:08:20 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c51d244b-417a-4bc8-bc87-a01ada874198 tempest-VolumeDependencyTests-206044551 None] Lock "cinder-quobyte-d65df9f4-b5aa-4911-a276-038604552ab8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:08:20 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-c51d244b-417a-4bc8-bc87-a01ada874198 tempest-VolumeDependencyTests-206044551 None] Deleting offline snapshot d65df9f4-b5aa-4911-a276-038604552ab8 of volume 18268b16-7730-47a0-8fba-61bf63b99ff4 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 10:08:20 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-c51d244b-417a-4bc8-bc87-a01ada874198 tempest-VolumeDependencyTests-206044551 None] snapshot_file for this snap is: volume-18268b16-7730-47a0-8fba-61bf63b99ff4.d65df9f4-b5aa-4911-a276-038604552ab8 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 10:08:20 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6b1596-b406-4dbd-833f-a02deb1ee3f8]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:08:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c51d244b-417a-4bc8-bc87-a01ada874198 tempest-VolumeDependencyTests-206044551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.d65df9f4-b5aa-4911-a276-038604552ab8 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:20 devstack sudo[113962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.d65df9f4-b5aa-4911-a276-038604552ab8 Jun 24 10:08:20 devstack sudo[113962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:20 devstack sudo[113962]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c51d244b-417a-4bc8-bc87-a01ada874198 tempest-VolumeDependencyTests-206044551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.d65df9f4-b5aa-4911-a276-038604552ab8" returned: 0 in 0.716s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:20 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-c51d244b-417a-4bc8-bc87-a01ada874198 tempest-VolumeDependencyTests-206044551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18268b16-7730-47a0-8fba-61bf63b99ff4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:08:20 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[15176959-be4d-4a7b-b230-57342c744974]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:08:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c51d244b-417a-4bc8-bc87-a01ada874198 tempest-VolumeDependencyTests-206044551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:21 devstack sudo[113967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4 Jun 24 10:08:21 devstack sudo[113967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:21 devstack sudo[113967]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c51d244b-417a-4bc8-bc87-a01ada874198 tempest-VolumeDependencyTests-206044551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4" returned: 0 in 0.716s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c51d244b-417a-4bc8-bc87-a01ada874198 tempest-VolumeDependencyTests-206044551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.d65df9f4-b5aa-4911-a276-038604552ab8 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:21 devstack sudo[113972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.d65df9f4-b5aa-4911-a276-038604552ab8 Jun 24 10:08:21 devstack sudo[113972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:22 devstack sudo[113972]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c51d244b-417a-4bc8-bc87-a01ada874198 tempest-VolumeDependencyTests-206044551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.d65df9f4-b5aa-4911-a276-038604552ab8" returned: 0 in 0.690s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c51d244b-417a-4bc8-bc87-a01ada874198 tempest-VolumeDependencyTests-206044551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.d65df9f4-b5aa-4911-a276-038604552ab8 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:22 devstack sudo[113978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.d65df9f4-b5aa-4911-a276-038604552ab8 Jun 24 10:08:22 devstack sudo[113978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:22 devstack sudo[113978]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c51d244b-417a-4bc8-bc87-a01ada874198 tempest-VolumeDependencyTests-206044551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4.d65df9f4-b5aa-4911-a276-038604552ab8" returned: 0 in 0.616s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:22 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c51d244b-417a-4bc8-bc87-a01ada874198 tempest-VolumeDependencyTests-206044551 None] Lock "cinder-quobyte-d65df9f4-b5aa-4911-a276-038604552ab8" released by "_delete_snapshot" :: held 2.828s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:08:22 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c51d244b-417a-4bc8-bc87-a01ada874198 tempest-VolumeDependencyTests-206044551 None] Lock "cinder-quobyte-18268b16-7730-47a0-8fba-61bf63b99ff4" released by "delete_snapshot" :: held 2.849s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:08:23 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-c51d244b-417a-4bc8-bc87-a01ada874198 tempest-VolumeDependencyTests-206044551 None] Created reservations ['baebc9eb-baba-45bc-acef-f94a8195b20a', 'e7544f91-57b3-4bdd-a950-8ebb08023336', '8229450c-0ac1-406d-b03e-78b1f0cb805d', '17c2dd9d-a070-455b-97eb-e8e5920cf255'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:08:23 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-c51d244b-417a-4bc8-bc87-a01ada874198 tempest-VolumeDependencyTests-206044551 None] Delete snapshot completed successfully. Jun 24 10:08:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-c51d244b-417a-4bc8-bc87-a01ada874198 tempest-VolumeDependencyTests-206044551 None] Lock "cinder-d65df9f4-b5aa-4911-a276-038604552ab8-delete_snapshot" released by "delete_snapshot" :: held 2.976s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:08:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9aefd0a4-a80b-41a5-bdc5-fa9c1199133a tempest-VolumeDependencyTests-206044551 None] Acquiring lock "cinder-18268b16-7730-47a0-8fba-61bf63b99ff4-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:08:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9aefd0a4-a80b-41a5-bdc5-fa9c1199133a tempest-VolumeDependencyTests-206044551 None] Lock "cinder-18268b16-7730-47a0-8fba-61bf63b99ff4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:08:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9aefd0a4-a80b-41a5-bdc5-fa9c1199133a tempest-VolumeDependencyTests-206044551 None] Acquiring lock "cinder-quobyte-18268b16-7730-47a0-8fba-61bf63b99ff4" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:08:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9aefd0a4-a80b-41a5-bdc5-fa9c1199133a tempest-VolumeDependencyTests-206044551 None] Lock "cinder-quobyte-18268b16-7730-47a0-8fba-61bf63b99ff4" acquired by "delete_volume" :: waited 0.014s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:08:23 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[100b24ce-fa81-4f4b-b96d-1b3947dd31c8]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:08:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9aefd0a4-a80b-41a5-bdc5-fa9c1199133a tempest-VolumeDependencyTests-206044551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:23 devstack sudo[113981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4 Jun 24 10:08:23 devstack sudo[113981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:24 devstack sudo[113981]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9aefd0a4-a80b-41a5-bdc5-fa9c1199133a tempest-VolumeDependencyTests-206044551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4" returned: 0 in 0.739s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9aefd0a4-a80b-41a5-bdc5-fa9c1199133a tempest-VolumeDependencyTests-206044551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:24 devstack sudo[113986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4 Jun 24 10:08:24 devstack sudo[113986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:24 devstack sudo[113986]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9aefd0a4-a80b-41a5-bdc5-fa9c1199133a tempest-VolumeDependencyTests-206044551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-18268b16-7730-47a0-8fba-61bf63b99ff4" returned: 0 in 0.616s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:24 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9aefd0a4-a80b-41a5-bdc5-fa9c1199133a tempest-VolumeDependencyTests-206044551 None] Lock "cinder-quobyte-18268b16-7730-47a0-8fba-61bf63b99ff4" released by "delete_volume" :: held 1.410s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:08:24 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-9aefd0a4-a80b-41a5-bdc5-fa9c1199133a tempest-VolumeDependencyTests-206044551 None] Created reservations ['ebdf82d5-16f2-4fc6-91fe-535b4fbe7fd3', 'a4af3d76-6433-4617-b16d-f0fd5e99d4a5', '3c60a0ce-19ab-4f48-9fb8-68b07a65c3d5', '4cf21586-8431-43b5-8ba3-511974421a8c'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:08:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9aefd0a4-a80b-41a5-bdc5-fa9c1199133a tempest-VolumeDependencyTests-206044551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9aefd0a4-a80b-41a5-bdc5-fa9c1199133a tempest-VolumeDependencyTests-206044551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9aefd0a4-a80b-41a5-bdc5-fa9c1199133a tempest-VolumeDependencyTests-206044551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:08:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9aefd0a4-a80b-41a5-bdc5-fa9c1199133a tempest-VolumeDependencyTests-206044551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:08:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9aefd0a4-a80b-41a5-bdc5-fa9c1199133a tempest-VolumeDependencyTests-206044551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9aefd0a4-a80b-41a5-bdc5-fa9c1199133a tempest-VolumeDependencyTests-206044551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:24 devstack sudo[113989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:08:24 devstack sudo[113989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 10:08:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:08:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:08:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:25 devstack sudo[113991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:08:25 devstack sudo[113991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:25 devstack sudo[113989]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9aefd0a4-a80b-41a5-bdc5-fa9c1199133a tempest-VolumeDependencyTests-206044551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.621s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-9aefd0a4-a80b-41a5-bdc5-fa9c1199133a tempest-VolumeDependencyTests-206044551 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:08:25 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-9aefd0a4-a80b-41a5-bdc5-fa9c1199133a tempest-VolumeDependencyTests-206044551 None] Deleted volume successfully. Jun 24 10:08:25 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-12902e21-e54a-48d1-94ff-f78687f8295f tempest-VolumeDependencyTests-206044551 None] Acquiring lock "cinder-a4e65c44-af8f-4477-9275-b21450e52ae9-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:08:25 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9aefd0a4-a80b-41a5-bdc5-fa9c1199133a tempest-VolumeDependencyTests-206044551 None] Lock "cinder-18268b16-7730-47a0-8fba-61bf63b99ff4-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:08:25 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-12902e21-e54a-48d1-94ff-f78687f8295f tempest-VolumeDependencyTests-206044551 None] Lock "cinder-a4e65c44-af8f-4477-9275-b21450e52ae9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:08:25 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-12902e21-e54a-48d1-94ff-f78687f8295f tempest-VolumeDependencyTests-206044551 None] Acquiring lock "cinder-quobyte-a4e65c44-af8f-4477-9275-b21450e52ae9" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:08:25 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-12902e21-e54a-48d1-94ff-f78687f8295f tempest-VolumeDependencyTests-206044551 None] Lock "cinder-quobyte-a4e65c44-af8f-4477-9275-b21450e52ae9" acquired by "delete_volume" :: waited 0.017s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:08:25 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b6d8af-46d8-4167-b1a4-646d4df30a3e]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:08:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-12902e21-e54a-48d1-94ff-f78687f8295f tempest-VolumeDependencyTests-206044551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a4e65c44-af8f-4477-9275-b21450e52ae9 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:25 devstack sudo[113991]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.669s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:08:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 10:08:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 28 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 10:08:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 10:08:25 devstack sudo[113995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a4e65c44-af8f-4477-9275-b21450e52ae9 Jun 24 10:08:25 devstack sudo[113995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:26 devstack sudo[113995]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-12902e21-e54a-48d1-94ff-f78687f8295f tempest-VolumeDependencyTests-206044551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a4e65c44-af8f-4477-9275-b21450e52ae9" returned: 0 in 0.728s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-12902e21-e54a-48d1-94ff-f78687f8295f tempest-VolumeDependencyTests-206044551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a4e65c44-af8f-4477-9275-b21450e52ae9 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:26 devstack sudo[114000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a4e65c44-af8f-4477-9275-b21450e52ae9 Jun 24 10:08:26 devstack sudo[114000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:27 devstack sudo[114000]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-12902e21-e54a-48d1-94ff-f78687f8295f tempest-VolumeDependencyTests-206044551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a4e65c44-af8f-4477-9275-b21450e52ae9" returned: 0 in 0.647s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-12902e21-e54a-48d1-94ff-f78687f8295f tempest-VolumeDependencyTests-206044551 None] Lock "cinder-quobyte-a4e65c44-af8f-4477-9275-b21450e52ae9" released by "delete_volume" :: held 1.421s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:08:27 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-12902e21-e54a-48d1-94ff-f78687f8295f tempest-VolumeDependencyTests-206044551 None] Created reservations ['6a8b04ab-5723-4417-a717-9cb075a79fc1', '35bc22e4-fc53-4440-8ec2-c0596ed07c1c', '565c7113-110e-45a2-bb11-895a6f08060c', '492224d8-095f-47ce-9890-b183aa2cd726'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:08:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-12902e21-e54a-48d1-94ff-f78687f8295f tempest-VolumeDependencyTests-206044551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-12902e21-e54a-48d1-94ff-f78687f8295f tempest-VolumeDependencyTests-206044551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-12902e21-e54a-48d1-94ff-f78687f8295f tempest-VolumeDependencyTests-206044551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:08:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-12902e21-e54a-48d1-94ff-f78687f8295f tempest-VolumeDependencyTests-206044551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:08:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-12902e21-e54a-48d1-94ff-f78687f8295f tempest-VolumeDependencyTests-206044551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-12902e21-e54a-48d1-94ff-f78687f8295f tempest-VolumeDependencyTests-206044551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:27 devstack sudo[114003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:08:27 devstack sudo[114003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:27 devstack sudo[114003]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-12902e21-e54a-48d1-94ff-f78687f8295f tempest-VolumeDependencyTests-206044551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.657s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:27 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-12902e21-e54a-48d1-94ff-f78687f8295f tempest-VolumeDependencyTests-206044551 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:08:27 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-12902e21-e54a-48d1-94ff-f78687f8295f tempest-VolumeDependencyTests-206044551 None] Deleted volume successfully. Jun 24 10:08:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-12902e21-e54a-48d1-94ff-f78687f8295f tempest-VolumeDependencyTests-206044551 None] Lock "cinder-a4e65c44-af8f-4477-9275-b21450e52ae9-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:08:37 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=65,cinder:INSERT=23,cinder:UPDATE=100,cinder:DELETE=7 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 10:08:37 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:UPDATE=88,cinder:SELECT=66,cinder:DELETE=10,cinder:INSERT=21 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 10:08:39 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:08:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Flow 'volume_create_manager' (0e64f80a-0e42-407e-b647-de67c5026ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:08:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ccacf84-6bf2-4d51-91cf-60ec163614f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ccacf84-6bf2-4d51-91cf-60ec163614f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1497552111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=697b60b9-de98-4069-9f1c-db5ccebd0b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8e15daa79f48c1acc808290c417a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:08:40Z,use_quota=True,user_id='390f9e987eb3462295db081684703760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78865e2e-1be2-4f8e-8ab1-de7ce3e4ffc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78865e2e-1be2-4f8e-8ab1-de7ce3e4ffc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24ae438-6e24-49a6-a253-0992a3e8c203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e24ae438-6e24-49a6-a253-0992a3e8c203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '697b60b9-de98-4069-9f1c-db5ccebd0b60', 'volume_name': 'volume-697b60b9-de98-4069-9f1c-db5ccebd0b60', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0873c8-de4d-49e7-bec8-3bbceae65a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0873c8-de4d-49e7-bec8-3bbceae65a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b88622e-8499-4469-a80f-72d76ffde591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:39 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Volume 697b60b9-de98-4069-9f1c-db5ccebd0b60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-697b60b9-de98-4069-9f1c-db5ccebd0b60', 'volume_size': 1} Jun 24 10:08:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1497552111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=697b60b9-de98-4069-9f1c-db5ccebd0b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8e15daa79f48c1acc808290c417a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:08:40Z,use_quota=True,user_id='390f9e987eb3462295db081684703760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:08:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Creating volume 697b60b9-de98-4069-9f1c-db5ccebd0b60 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:08:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:08:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:08:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:08:39 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:08:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:39 devstack sudo[114082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 1073741824 Jun 24 10:08:39 devstack sudo[114082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:39 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:08:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Flow 'volume_create_manager' (64a5635f-105f-4baf-b1c0-f93bfdec21bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:08:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028a468f-9769-4e4f-bced-81d08d49dd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028a468f-9769-4e4f-bced-81d08d49dd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1210439184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=139b3c1c-0dfe-4958-9ddb-2d060e4b0e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d061c96c3e4d46bb63b366e839aa43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:08:40Z,use_quota=True,user_id='c9c1bb2dcf1940e0bacd7550f16ef83f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a09a05e9-493e-4d7d-a6f4-e4c317ec4efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a09a05e9-493e-4d7d-a6f4-e4c317ec4efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c77292-df63-46d9-b9d9-e015c0f0517b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c77292-df63-46d9-b9d9-e015c0f0517b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '139b3c1c-0dfe-4958-9ddb-2d060e4b0e87', 'volume_name': 'volume-139b3c1c-0dfe-4958-9ddb-2d060e4b0e87', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5f7df2-01e1-499a-91a2-cfa032e58a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5f7df2-01e1-499a-91a2-cfa032e58a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f0020e-83eb-482f-ad58-eacad4c69399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:40 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Volume 139b3c1c-0dfe-4958-9ddb-2d060e4b0e87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-139b3c1c-0dfe-4958-9ddb-2d060e4b0e87', 'volume_size': 1} Jun 24 10:08:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:40 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:08:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Flow 'volume_create_manager' (e455a76d-8ace-4d65-b0bd-31b7fca782b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:08:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f028f8a-db4a-4f46-8054-51de6c2773ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f028f8a-db4a-4f46-8054-51de6c2773ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1032733116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60939ce6-e74e-4938-8389-d54b0b00fa4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d061c96c3e4d46bb63b366e839aa43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:08:40Z,use_quota=True,user_id='c9c1bb2dcf1940e0bacd7550f16ef83f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8eca005-8563-440a-bb9d-fc1f7e35a0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8eca005-8563-440a-bb9d-fc1f7e35a0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6fdb8d4-e6ef-4e9b-ad58-a04b95dde7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6fdb8d4-e6ef-4e9b-ad58-a04b95dde7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60939ce6-e74e-4938-8389-d54b0b00fa4a', 'volume_name': 'volume-60939ce6-e74e-4938-8389-d54b0b00fa4a', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6bbb75-024e-4fe2-9bd7-3369387626b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6bbb75-024e-4fe2-9bd7-3369387626b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a14678ce-4fbc-47ec-a01b-db7f1b5b83ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:40 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Volume 60939ce6-e74e-4938-8389-d54b0b00fa4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60939ce6-e74e-4938-8389-d54b0b00fa4a', 'volume_size': 1} Jun 24 10:08:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Flow 'volume_create_manager' (b010bb60-46da-45e2-be7e-fa22579a6614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be1e801f-c6fd-4049-a98b-347e82f88953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be1e801f-c6fd-4049-a98b-347e82f88953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2131919745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8703a71b-c70a-4eb6-9518-2a509f49f9ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d061c96c3e4d46bb63b366e839aa43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:08:41Z,use_quota=True,user_id='c9c1bb2dcf1940e0bacd7550f16ef83f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6f65f0-97c8-48e1-a5d1-a9cc05c21512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:41 devstack sudo[114082]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6f65f0-97c8-48e1-a5d1-a9cc05c21512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c78edfa9-9a6f-4b53-b409-4a62f4ff0f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c78edfa9-9a6f-4b53-b409-4a62f4ff0f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8703a71b-c70a-4eb6-9518-2a509f49f9ae', 'volume_name': 'volume-8703a71b-c70a-4eb6-9518-2a509f49f9ae', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48bfa55-4584-4ba5-a241-21ce95b73b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48bfa55-4584-4ba5-a241-21ce95b73b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d64f9712-9d7e-4eab-a403-124fdfe4ef05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:41 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Volume 8703a71b-c70a-4eb6-9518-2a509f49f9ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8703a71b-c70a-4eb6-9518-2a509f49f9ae', 'volume_size': 1} Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 1073741824" returned: 0 in 1.560s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:41 devstack sudo[114088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 Jun 24 10:08:41 devstack sudo[114088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Flow 'volume_create_manager' (2f171b2c-1bdf-438c-a8c7-59284010d01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e10a301-19a6-4fa8-9b6d-266202629363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e10a301-19a6-4fa8-9b6d-266202629363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-688989808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44891c9e-a78d-4fba-816e-8b8f93306649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d061c96c3e4d46bb63b366e839aa43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:08:42Z,use_quota=True,user_id='c9c1bb2dcf1940e0bacd7550f16ef83f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14b9c8e0-5de5-49cf-85cf-f17a8a9b8648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14b9c8e0-5de5-49cf-85cf-f17a8a9b8648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400801db-40d6-471f-b320-1bb67b676d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (400801db-40d6-471f-b320-1bb67b676d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44891c9e-a78d-4fba-816e-8b8f93306649', 'volume_name': 'volume-44891c9e-a78d-4fba-816e-8b8f93306649', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500fd53f-2264-4f95-91ca-6eb3049312f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500fd53f-2264-4f95-91ca-6eb3049312f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e9564e-7d2c-43f3-83f1-68bc57b44b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:41 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Volume 44891c9e-a78d-4fba-816e-8b8f93306649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44891c9e-a78d-4fba-816e-8b8f93306649', 'volume_size': 1} Jun 24 10:08:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Flow 'volume_create_manager' (ed5a58d9-928d-4717-b7c1-7fd17727099e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a345a37-1af8-4ac4-9d88-420085dfcfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a345a37-1af8-4ac4-9d88-420085dfcfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-87187207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05fd48b0-a801-4307-897d-b8965d88f07e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d061c96c3e4d46bb63b366e839aa43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:08:42Z,use_quota=True,user_id='c9c1bb2dcf1940e0bacd7550f16ef83f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebab0442-29a1-463a-ad99-b54d139bc7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebab0442-29a1-463a-ad99-b54d139bc7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54a804b3-2af4-4d8d-bd30-0a75653aec86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54a804b3-2af4-4d8d-bd30-0a75653aec86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05fd48b0-a801-4307-897d-b8965d88f07e', 'volume_name': 'volume-05fd48b0-a801-4307-897d-b8965d88f07e', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2830029a-9445-42a9-a565-3feebb24519c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2830029a-9445-42a9-a565-3feebb24519c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51b6e78e-35b6-4b8a-a80a-af0e8da9e5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:42 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Volume 05fd48b0-a801-4307-897d-b8965d88f07e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05fd48b0-a801-4307-897d-b8965d88f07e', 'volume_size': 1} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:42 devstack sudo[114088]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60" returned: 0 in 0.878s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] <== create_volume: return (2515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.520s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.237s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1210439184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=139b3c1c-0dfe-4958-9ddb-2d060e4b0e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d061c96c3e4d46bb63b366e839aa43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:08:40Z,use_quota=True,user_id='c9c1bb2dcf1940e0bacd7550f16ef83f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Creating volume 139b3c1c-0dfe-4958-9ddb-2d060e4b0e87 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:08:42 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-139b3c1c-0dfe-4958-9ddb-2d060e4b0e87 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:42 devstack sudo[114092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-139b3c1c-0dfe-4958-9ddb-2d060e4b0e87 1073741824 Jun 24 10:08:42 devstack sudo[114092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b88622e-8499-4469-a80f-72d76ffde591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-697b60b9-de98-4069-9f1c-db5ccebd0b60', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01ffea7-0a34-4792-b098-820ebc90ecc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:42 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Volume volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 (697b60b9-de98-4069-9f1c-db5ccebd0b60): created successfully Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01ffea7-0a34-4792-b098-820ebc90ecc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Flow 'volume_create_manager' (0e64f80a-0e42-407e-b647-de67c5026ece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:08:42 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-8c1cba7b-eea9-4109-952b-7f013529a21d tempest-VolumeDependencyTests-1737952209 None] Created volume successfully. Jun 24 10:08:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-16be0f49-2aaf-4661-b5fc-2873669d60b3 tempest-VolumeDependencyTests-1737952209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:43 devstack sudo[114092]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-139b3c1c-0dfe-4958-9ddb-2d060e4b0e87 1073741824" returned: 0 in 1.017s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-139b3c1c-0dfe-4958-9ddb-2d060e4b0e87 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:43 devstack sudo[114098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-139b3c1c-0dfe-4958-9ddb-2d060e4b0e87 Jun 24 10:08:43 devstack sudo[114098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:44 devstack sudo[114098]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-139b3c1c-0dfe-4958-9ddb-2d060e4b0e87" returned: 0 in 0.717s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.568s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1032733116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60939ce6-e74e-4938-8389-d54b0b00fa4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d061c96c3e4d46bb63b366e839aa43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:08:40Z,use_quota=True,user_id='c9c1bb2dcf1940e0bacd7550f16ef83f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Creating volume 60939ce6-e74e-4938-8389-d54b0b00fa4a {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:08:44 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-60939ce6-e74e-4938-8389-d54b0b00fa4a 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:44 devstack sudo[114101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-60939ce6-e74e-4938-8389-d54b0b00fa4a 1073741824 Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f0020e-83eb-482f-ad58-eacad4c69399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-139b3c1c-0dfe-4958-9ddb-2d060e4b0e87', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:44 devstack sudo[114101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa50ad4-ec1e-4c68-abf4-d47320328a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:44 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Volume volume-139b3c1c-0dfe-4958-9ddb-2d060e4b0e87 (139b3c1c-0dfe-4958-9ddb-2d060e4b0e87): created successfully Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa50ad4-ec1e-4c68-abf4-d47320328a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Flow 'volume_create_manager' (64a5635f-105f-4baf-b1c0-f93bfdec21bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:08:44 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-92bc4403-af46-42d1-b22b-2ad544a44580 tempest-CreateVolumesFromImageTest-714115052 None] Created volume successfully. Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Flow 'volume_create_manager' (edfe3368-d1ca-4f50-9af9-bfc8e867be11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b6261d6-df5a-4a1d-84c2-a80572df5031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b6261d6-df5a-4a1d-84c2-a80572df5031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19d28643-a0cd-41d8-9464-5e970cbe3713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6058ca5598e4a6b84a11109517ba1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:08:45Z,use_quota=True,user_id='4eecfa6eb4324a67bfdd562c2435443a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcd59caa-77f6-40e0-af27-ed56cba5d93d),volume_type_id=bcd59caa-77f6-40e0-af27-ed56cba5d93d)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4bd7f2-3fce-440f-925c-1ee3c2e794df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4bd7f2-3fce-440f-925c-1ee3c2e794df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d8c91c-9329-4d4e-bf4f-b4b01c39aea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:44 devstack cinder-volume[93447]: DEBUG cinder.image.glance [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Creating Keystone auth plugin from conf {{(pid=93447) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 10:08:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d8c91c-9329-4d4e-bf4f-b4b01c39aea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '19d28643-a0cd-41d8-9464-5e970cbe3713', 'volume_name': 'volume-19d28643-a0cd-41d8-9464-5e970cbe3713', 'volume_size': 1, 'image_id': '24eef098-a286-4809-86c0-dc8d8a815bb2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24eef098-a286-4809-86c0-dc8d8a815bb2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '84453985479eb8bf5126fb95cda34919', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e6058ca5598e4a6b84a11109517ba1bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '760398fa431109ba16bee952c028b88705641b4953a459e493e863bc83795ab2c8ef202c2dfa30226f08045850f087ab914e03a776c27e89eec71c4869b2f903', 'id': '24eef098-a286-4809-86c0-dc8d8a815bb2', 'created_at': datetime.datetime(2026, 6, 24, 8, 8, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 8, 8, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24eef098-a286-4809-86c0-dc8d8a815bb2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15243bde-bc83-4443-98dc-5ea0c52299d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15243bde-bc83-4443-98dc-5ea0c52299d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16e81d8-0931-467e-9c38-68deeb847890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:45 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Volume 19d28643-a0cd-41d8-9464-5e970cbe3713: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-19d28643-a0cd-41d8-9464-5e970cbe3713', 'volume_size': 1, 'image_id': '24eef098-a286-4809-86c0-dc8d8a815bb2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24eef098-a286-4809-86c0-dc8d8a815bb2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '84453985479eb8bf5126fb95cda34919', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e6058ca5598e4a6b84a11109517ba1bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '760398fa431109ba16bee952c028b88705641b4953a459e493e863bc83795ab2c8ef202c2dfa30226f08045850f087ab914e03a776c27e89eec71c4869b2f903', 'id': '24eef098-a286-4809-86c0-dc8d8a815bb2', 'created_at': datetime.datetime(2026, 6, 24, 8, 8, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 8, 8, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24eef098-a286-4809-86c0-dc8d8a815bb2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 24 10:08:45 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Trying to clone 19d28643-a0cd-41d8-9464-5e970cbe3713 from image 24eef098-a286-4809-86c0-dc8d8a815bb2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/24eef098-a286-4809-86c0-dc8d8a815bb2', 'metadata': {}}]). {{(pid=93447) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 10:08:45 devstack sudo[114101]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-60939ce6-e74e-4938-8389-d54b0b00fa4a 1073741824" returned: 0 in 0.946s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-60939ce6-e74e-4938-8389-d54b0b00fa4a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:45 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 10:08:45 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Image download 0.00 MB at 0.00 MB/s Jun 24 10:08:45 devstack sudo[114107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-60939ce6-e74e-4938-8389-d54b0b00fa4a Jun 24 10:08:45 devstack sudo[114107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:45 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[049fd1b6-b764-4db2-9c57-fa24727fffc4]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:08:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:45 devstack sudo[114109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD Jun 24 10:08:45 devstack sudo[114109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:46 devstack sudo[114107]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-60939ce6-e74e-4938-8389-d54b0b00fa4a" returned: 0 in 0.922s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:08:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.929s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.667s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2131919745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8703a71b-c70a-4eb6-9518-2a509f49f9ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d061c96c3e4d46bb63b366e839aa43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:08:41Z,use_quota=True,user_id='c9c1bb2dcf1940e0bacd7550f16ef83f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:08:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Creating volume 8703a71b-c70a-4eb6-9518-2a509f49f9ae {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:08:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:08:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:08:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:46 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:08:46 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:08:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8703a71b-c70a-4eb6-9518-2a509f49f9ae 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:46 devstack sudo[114109]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD" returned: 0 in 0.886s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:46 devstack sudo[114114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8703a71b-c70a-4eb6-9518-2a509f49f9ae 1073741824 Jun 24 10:08:46 devstack sudo[114114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a14678ce-4fbc-47ec-a01b-db7f1b5b83ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60939ce6-e74e-4938-8389-d54b0b00fa4a', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a79b806-a896-4a3d-b88d-e18221d5da6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:46 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Volume volume-60939ce6-e74e-4938-8389-d54b0b00fa4a (60939ce6-e74e-4938-8389-d54b0b00fa4a): created successfully Jun 24 10:08:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a79b806-a896-4a3d-b88d-e18221d5da6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:46 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Flow 'volume_create_manager' (e455a76d-8ace-4d65-b0bd-31b7fca782b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:08:46 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-a285ecab-68c5-4de3-b15e-5b00c416c579 tempest-CreateVolumesFromImageTest-714115052 None] Created volume successfully. Jun 24 10:08:46 devstack sudo[114115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD Jun 24 10:08:46 devstack sudo[114115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:47 devstack sudo[114115]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD" returned: 1 in 0.921s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:08:47 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Temporary image 24eef098-a286-4809-86c0-dc8d8a815bb2 is fetched for user 4eecfa6eb4324a67bfdd562c2435443a. {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 10:08:47 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff3a47f-92e9-4c0e-a207-6002f56c6e85]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:08:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:47 devstack sudo[114114]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8703a71b-c70a-4eb6-9518-2a509f49f9ae 1073741824" returned: 0 in 1.088s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8703a71b-c70a-4eb6-9518-2a509f49f9ae {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:47 devstack sudo[114126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8703a71b-c70a-4eb6-9518-2a509f49f9ae Jun 24 10:08:47 devstack sudo[114126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:47 devstack sudo[114125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD Jun 24 10:08:47 devstack sudo[114125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:47 devstack sudo[114125]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD" returned: 0 in 0.815s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:47 devstack sudo[114126]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8703a71b-c70a-4eb6-9518-2a509f49f9ae" returned: 0 in 0.738s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:08:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.095s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-688989808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44891c9e-a78d-4fba-816e-8b8f93306649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d061c96c3e4d46bb63b366e839aa43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:08:42Z,use_quota=True,user_id='c9c1bb2dcf1940e0bacd7550f16ef83f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:08:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Creating volume 44891c9e-a78d-4fba-816e-8b8f93306649 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:08:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:08:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:08:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:08:47 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:08:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-44891c9e-a78d-4fba-816e-8b8f93306649 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d64f9712-9d7e-4eab-a403-124fdfe4ef05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8703a71b-c70a-4eb6-9518-2a509f49f9ae', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da8e6ba-3fbb-4a02-b8af-2e10c314c7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:48 devstack sudo[114133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-44891c9e-a78d-4fba-816e-8b8f93306649 1073741824 Jun 24 10:08:48 devstack sudo[114133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:48 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Volume volume-8703a71b-c70a-4eb6-9518-2a509f49f9ae (8703a71b-c70a-4eb6-9518-2a509f49f9ae): created successfully Jun 24 10:08:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da8e6ba-3fbb-4a02-b8af-2e10c314c7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:48 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Flow 'volume_create_manager' (b010bb60-46da-45e2-be7e-fa22579a6614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:08:48 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-ac240e58-e5f3-4355-8b4f-607f03a774b1 tempest-CreateVolumesFromImageTest-714115052 None] Created volume successfully. Jun 24 10:08:48 devstack sudo[114132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD Jun 24 10:08:48 devstack sudo[114132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:49 devstack sudo[114132]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD" returned: 1 in 1.041s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:08:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:49 devstack sudo[114133]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-44891c9e-a78d-4fba-816e-8b8f93306649 1073741824" returned: 0 in 1.098s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-44891c9e-a78d-4fba-816e-8b8f93306649 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:49 devstack sudo[114143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-44891c9e-a78d-4fba-816e-8b8f93306649 Jun 24 10:08:49 devstack sudo[114143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:49 devstack sudo[114143]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-44891c9e-a78d-4fba-816e-8b8f93306649" returned: 0 in 0.675s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:49 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:08:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.573s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:49 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-87187207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05fd48b0-a801-4307-897d-b8965d88f07e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d061c96c3e4d46bb63b366e839aa43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:08:42Z,use_quota=True,user_id='c9c1bb2dcf1940e0bacd7550f16ef83f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:08:49 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Creating volume 05fd48b0-a801-4307-897d-b8965d88f07e {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:08:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:49 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:08:49 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:08:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:49 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:08:49 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:08:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-05fd48b0-a801-4307-897d-b8965d88f07e 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:49 devstack sudo[114146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-05fd48b0-a801-4307-897d-b8965d88f07e 1073741824 Jun 24 10:08:49 devstack sudo[114146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:49 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e9564e-7d2c-43f3-83f1-68bc57b44b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44891c9e-a78d-4fba-816e-8b8f93306649', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:49 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8eb48c-206e-4bc2-ac17-17bea3109ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:49 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Volume volume-44891c9e-a78d-4fba-816e-8b8f93306649 (44891c9e-a78d-4fba-816e-8b8f93306649): created successfully Jun 24 10:08:49 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad8eb48c-206e-4bc2-ac17-17bea3109ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:49 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Flow 'volume_create_manager' (2f171b2c-1bdf-438c-a8c7-59284010d01f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:08:49 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-c5530a92-9346-453e-9458-4357e8e458c4 tempest-CreateVolumesFromImageTest-714115052 None] Created volume successfully. Jun 24 10:08:50 devstack sudo[114146]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-05fd48b0-a801-4307-897d-b8965d88f07e 1073741824" returned: 0 in 0.916s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-05fd48b0-a801-4307-897d-b8965d88f07e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:50 devstack sudo[114152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-05fd48b0-a801-4307-897d-b8965d88f07e Jun 24 10:08:50 devstack sudo[114152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:51 devstack sudo[114152]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-05fd48b0-a801-4307-897d-b8965d88f07e" returned: 0 in 0.689s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:51 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:08:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-16be0f49-2aaf-4661-b5fc-2873669d60b3 tempest-VolumeDependencyTests-1737952209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.306s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:51 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-16be0f49-2aaf-4661-b5fc-2873669d60b3 tempest-VolumeDependencyTests-1737952209 None] Creating offline snapshot b15a567f-d430-49d4-a5af-a66484b3bf0c of volume 697b60b9-de98-4069-9f1c-db5ccebd0b60 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 10:08:51 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51b6e78e-35b6-4b8a-a80a-af0e8da9e5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05fd48b0-a801-4307-897d-b8965d88f07e', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:51 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb3861d2-7034-4c62-b9e8-7f62ba0e7777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:51 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee31f93-7991-43a4-b069-9fabda94a9ed]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:08:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-16be0f49-2aaf-4661-b5fc-2873669d60b3 tempest-VolumeDependencyTests-1737952209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:51 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Volume volume-05fd48b0-a801-4307-897d-b8965d88f07e (05fd48b0-a801-4307-897d-b8965d88f07e): created successfully Jun 24 10:08:51 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb3861d2-7034-4c62-b9e8-7f62ba0e7777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:51 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Flow 'volume_create_manager' (ed5a58d9-928d-4717-b7c1-7fd17727099e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:08:51 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-61d0d3ed-9c4b-454d-8387-fdaf0853b087 tempest-CreateVolumesFromImageTest-714115052 None] Created volume successfully. Jun 24 10:08:51 devstack sudo[114157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 Jun 24 10:08:51 devstack sudo[114157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:52 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-06427120-6c48-4cb7-a031-e6debc2ad7ab tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "cinder-05fd48b0-a801-4307-897d-b8965d88f07e-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:08:52 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-06427120-6c48-4cb7-a031-e6debc2ad7ab tempest-CreateVolumesFromImageTest-714115052 None] Lock "cinder-05fd48b0-a801-4307-897d-b8965d88f07e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:08:52 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-06427120-6c48-4cb7-a031-e6debc2ad7ab tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "cinder-quobyte-05fd48b0-a801-4307-897d-b8965d88f07e" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:08:52 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-06427120-6c48-4cb7-a031-e6debc2ad7ab tempest-CreateVolumesFromImageTest-714115052 None] Lock "cinder-quobyte-05fd48b0-a801-4307-897d-b8965d88f07e" acquired by "delete_volume" :: waited 0.029s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:08:52 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d748049a-5587-4014-808e-391a1500cb73]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:08:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-06427120-6c48-4cb7-a031-e6debc2ad7ab tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-05fd48b0-a801-4307-897d-b8965d88f07e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:52 devstack sudo[114163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-05fd48b0-a801-4307-897d-b8965d88f07e Jun 24 10:08:52 devstack sudo[114163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:52 devstack sudo[114157]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-16be0f49-2aaf-4661-b5fc-2873669d60b3 tempest-VolumeDependencyTests-1737952209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60" returned: 0 in 0.962s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-16be0f49-2aaf-4661-b5fc-2873669d60b3 tempest-VolumeDependencyTests-1737952209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.b15a567f-d430-49d4-a5af-a66484b3bf0c 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:52 devstack sudo[114165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.b15a567f-d430-49d4-a5af-a66484b3bf0c 1G Jun 24 10:08:52 devstack sudo[114165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:53 devstack sudo[114163]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-06427120-6c48-4cb7-a031-e6debc2ad7ab tempest-CreateVolumesFromImageTest-714115052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-05fd48b0-a801-4307-897d-b8965d88f07e" returned: 0 in 0.859s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-06427120-6c48-4cb7-a031-e6debc2ad7ab tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-05fd48b0-a801-4307-897d-b8965d88f07e {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:53 devstack sudo[114173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-05fd48b0-a801-4307-897d-b8965d88f07e Jun 24 10:08:53 devstack sudo[114173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:53 devstack sudo[114165]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-16be0f49-2aaf-4661-b5fc-2873669d60b3 tempest-VolumeDependencyTests-1737952209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.b15a567f-d430-49d4-a5af-a66484b3bf0c 1G" returned: 0 in 0.975s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-16be0f49-2aaf-4661-b5fc-2873669d60b3 tempest-VolumeDependencyTests-1737952209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.b15a567f-d430-49d4-a5af-a66484b3bf0c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:53 devstack sudo[114176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.b15a567f-d430-49d4-a5af-a66484b3bf0c Jun 24 10:08:53 devstack sudo[114176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:53 devstack sudo[114173]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-06427120-6c48-4cb7-a031-e6debc2ad7ab tempest-CreateVolumesFromImageTest-714115052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-05fd48b0-a801-4307-897d-b8965d88f07e" returned: 0 in 0.741s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:53 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-06427120-6c48-4cb7-a031-e6debc2ad7ab tempest-CreateVolumesFromImageTest-714115052 None] Lock "cinder-quobyte-05fd48b0-a801-4307-897d-b8965d88f07e" released by "delete_volume" :: held 1.650s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:08:54 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-06427120-6c48-4cb7-a031-e6debc2ad7ab tempest-CreateVolumesFromImageTest-714115052 None] Created reservations ['bffde204-d46e-409f-877d-aaca405118b7', 'f92fcac5-3b92-4c02-ad13-823936540bde', '6b3958c5-822b-4cb7-ae82-09a5ae9546bc', 'efb2d48a-b702-4f73-b3a6-2cdecc05726b'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:08:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-06427120-6c48-4cb7-a031-e6debc2ad7ab tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-06427120-6c48-4cb7-a031-e6debc2ad7ab tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:54 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-06427120-6c48-4cb7-a031-e6debc2ad7ab tempest-CreateVolumesFromImageTest-714115052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:08:54 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-06427120-6c48-4cb7-a031-e6debc2ad7ab tempest-CreateVolumesFromImageTest-714115052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:08:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-06427120-6c48-4cb7-a031-e6debc2ad7ab tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-06427120-6c48-4cb7-a031-e6debc2ad7ab tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:54 devstack sudo[114184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:08:54 devstack sudo[114184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:54 devstack sudo[114176]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-16be0f49-2aaf-4661-b5fc-2873669d60b3 tempest-VolumeDependencyTests-1737952209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.b15a567f-d430-49d4-a5af-a66484b3bf0c" returned: 0 in 0.864s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:54 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-16be0f49-2aaf-4661-b5fc-2873669d60b3 tempest-VolumeDependencyTests-1737952209 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.b15a567f-d430-49d4-a5af-a66484b3bf0c is being set with open permissions: ugo+rw Jun 24 10:08:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-16be0f49-2aaf-4661-b5fc-2873669d60b3 tempest-VolumeDependencyTests-1737952209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.b15a567f-d430-49d4-a5af-a66484b3bf0c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:54 devstack sudo[114186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.b15a567f-d430-49d4-a5af-a66484b3bf0c Jun 24 10:08:54 devstack sudo[114186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:54 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9ebd6fdf-c0f6-4210-b20c-447bbb5d8359 tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "cinder-44891c9e-a78d-4fba-816e-8b8f93306649-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:08:54 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9ebd6fdf-c0f6-4210-b20c-447bbb5d8359 tempest-CreateVolumesFromImageTest-714115052 None] Lock "cinder-44891c9e-a78d-4fba-816e-8b8f93306649-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:08:54 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9ebd6fdf-c0f6-4210-b20c-447bbb5d8359 tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "cinder-quobyte-44891c9e-a78d-4fba-816e-8b8f93306649" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:08:54 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9ebd6fdf-c0f6-4210-b20c-447bbb5d8359 tempest-CreateVolumesFromImageTest-714115052 None] Lock "cinder-quobyte-44891c9e-a78d-4fba-816e-8b8f93306649" acquired by "delete_volume" :: waited 0.022s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:08:54 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f001d35-b4ce-4bab-bda6-b745043e2428]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:08:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9ebd6fdf-c0f6-4210-b20c-447bbb5d8359 tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-44891c9e-a78d-4fba-816e-8b8f93306649 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:54 devstack sudo[114188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-44891c9e-a78d-4fba-816e-8b8f93306649 Jun 24 10:08:54 devstack sudo[114188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:54 devstack sudo[114184]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-06427120-6c48-4cb7-a031-e6debc2ad7ab tempest-CreateVolumesFromImageTest-714115052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.735s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:54 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-06427120-6c48-4cb7-a031-e6debc2ad7ab tempest-CreateVolumesFromImageTest-714115052 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:08:54 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-06427120-6c48-4cb7-a031-e6debc2ad7ab tempest-CreateVolumesFromImageTest-714115052 None] Deleted volume successfully. Jun 24 10:08:54 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-06427120-6c48-4cb7-a031-e6debc2ad7ab tempest-CreateVolumesFromImageTest-714115052 None] Lock "cinder-05fd48b0-a801-4307-897d-b8965d88f07e-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:08:55 devstack sudo[114186]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-16be0f49-2aaf-4661-b5fc-2873669d60b3 tempest-VolumeDependencyTests-1737952209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.b15a567f-d430-49d4-a5af-a66484b3bf0c" returned: 0 in 0.891s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-16be0f49-2aaf-4661-b5fc-2873669d60b3 tempest-VolumeDependencyTests-1737952209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:55 devstack sudo[114192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.info Jun 24 10:08:55 devstack sudo[114192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:55 devstack sudo[114188]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9ebd6fdf-c0f6-4210-b20c-447bbb5d8359 tempest-CreateVolumesFromImageTest-714115052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-44891c9e-a78d-4fba-816e-8b8f93306649" returned: 0 in 0.942s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9ebd6fdf-c0f6-4210-b20c-447bbb5d8359 tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-44891c9e-a78d-4fba-816e-8b8f93306649 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:55 devstack sudo[114197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-44891c9e-a78d-4fba-816e-8b8f93306649 Jun 24 10:08:55 devstack sudo[114197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:55 devstack sudo[114192]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-16be0f49-2aaf-4661-b5fc-2873669d60b3 tempest-VolumeDependencyTests-1737952209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.info" returned: 0 in 0.730s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:55 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-16be0f49-2aaf-4661-b5fc-2873669d60b3 tempest-VolumeDependencyTests-1737952209 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.info is being set with open permissions: ugo+rw Jun 24 10:08:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-16be0f49-2aaf-4661-b5fc-2873669d60b3 tempest-VolumeDependencyTests-1737952209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:56 devstack sudo[114200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.info Jun 24 10:08:56 devstack sudo[114200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:56 devstack sudo[114197]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9ebd6fdf-c0f6-4210-b20c-447bbb5d8359 tempest-CreateVolumesFromImageTest-714115052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-44891c9e-a78d-4fba-816e-8b8f93306649" returned: 0 in 0.808s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:56 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9ebd6fdf-c0f6-4210-b20c-447bbb5d8359 tempest-CreateVolumesFromImageTest-714115052 None] Lock "cinder-quobyte-44891c9e-a78d-4fba-816e-8b8f93306649" released by "delete_volume" :: held 1.810s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:08:56 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-9ebd6fdf-c0f6-4210-b20c-447bbb5d8359 tempest-CreateVolumesFromImageTest-714115052 None] Created reservations ['ea93dcfc-699e-459e-8f44-f645f1ffdb41', 'b8b0a2cf-6796-4909-8ac4-78b902a3693d', 'ccd31e7f-ea5d-4bb1-93cd-8a228826e83c', '44fd0100-481c-44ee-b9c4-ed2bbac64fd2'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:08:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9ebd6fdf-c0f6-4210-b20c-447bbb5d8359 tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9ebd6fdf-c0f6-4210-b20c-447bbb5d8359 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:56 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9ebd6fdf-c0f6-4210-b20c-447bbb5d8359 tempest-CreateVolumesFromImageTest-714115052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:08:56 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9ebd6fdf-c0f6-4210-b20c-447bbb5d8359 tempest-CreateVolumesFromImageTest-714115052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:08:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9ebd6fdf-c0f6-4210-b20c-447bbb5d8359 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9ebd6fdf-c0f6-4210-b20c-447bbb5d8359 tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:56 devstack sudo[114204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:08:56 devstack sudo[114204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:56 devstack sudo[114200]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-16be0f49-2aaf-4661-b5fc-2873669d60b3 tempest-VolumeDependencyTests-1737952209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.info" returned: 0 in 0.771s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-16be0f49-2aaf-4661-b5fc-2873669d60b3 tempest-VolumeDependencyTests-1737952209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.320s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.797s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:56 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19d28643-a0cd-41d8-9464-5e970cbe3713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6058ca5598e4a6b84a11109517ba1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:08:45Z,use_quota=True,user_id='4eecfa6eb4324a67bfdd562c2435443a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcd59caa-77f6-40e0-af27-ed56cba5d93d),volume_type_id=bcd59caa-77f6-40e0-af27-ed56cba5d93d)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:08:56 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Creating volume 19d28643-a0cd-41d8-9464-5e970cbe3713 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:08:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:56 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:08:56 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:08:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:56 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:08:56 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:08:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:56 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-effa045e-c75b-41d7-b6bd-d622b67a76b7 tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "cinder-8703a71b-c70a-4eb6-9518-2a509f49f9ae-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:08:56 devstack sudo[114206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713 1073741824 Jun 24 10:08:56 devstack sudo[114206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:56 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-effa045e-c75b-41d7-b6bd-d622b67a76b7 tempest-CreateVolumesFromImageTest-714115052 None] Lock "cinder-8703a71b-c70a-4eb6-9518-2a509f49f9ae-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:08:56 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-16be0f49-2aaf-4661-b5fc-2873669d60b3 tempest-VolumeDependencyTests-1737952209 None] Create snapshot completed successfully Jun 24 10:08:57 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-effa045e-c75b-41d7-b6bd-d622b67a76b7 tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "cinder-quobyte-8703a71b-c70a-4eb6-9518-2a509f49f9ae" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:08:57 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-effa045e-c75b-41d7-b6bd-d622b67a76b7 tempest-CreateVolumesFromImageTest-714115052 None] Lock "cinder-quobyte-8703a71b-c70a-4eb6-9518-2a509f49f9ae" acquired by "delete_volume" :: waited 0.026s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:08:57 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cd23c6-49f1-4002-9441-aa2f96b9ccd3]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:08:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-effa045e-c75b-41d7-b6bd-d622b67a76b7 tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8703a71b-c70a-4eb6-9518-2a509f49f9ae {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:57 devstack sudo[114208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8703a71b-c70a-4eb6-9518-2a509f49f9ae Jun 24 10:08:57 devstack sudo[114208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:57 devstack sudo[114204]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9ebd6fdf-c0f6-4210-b20c-447bbb5d8359 tempest-CreateVolumesFromImageTest-714115052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.013s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:57 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-9ebd6fdf-c0f6-4210-b20c-447bbb5d8359 tempest-CreateVolumesFromImageTest-714115052 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:08:57 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-9ebd6fdf-c0f6-4210-b20c-447bbb5d8359 tempest-CreateVolumesFromImageTest-714115052 None] Deleted volume successfully. Jun 24 10:08:57 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9ebd6fdf-c0f6-4210-b20c-447bbb5d8359 tempest-CreateVolumesFromImageTest-714115052 None] Lock "cinder-44891c9e-a78d-4fba-816e-8b8f93306649-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:08:57 devstack sudo[114206]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713 1073741824" returned: 0 in 1.166s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:58 devstack sudo[114217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713 Jun 24 10:08:58 devstack sudo[114217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:58 devstack sudo[114208]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-effa045e-c75b-41d7-b6bd-d622b67a76b7 tempest-CreateVolumesFromImageTest-714115052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8703a71b-c70a-4eb6-9518-2a509f49f9ae" returned: 0 in 1.134s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-effa045e-c75b-41d7-b6bd-d622b67a76b7 tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8703a71b-c70a-4eb6-9518-2a509f49f9ae {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:58 devstack sudo[114220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8703a71b-c70a-4eb6-9518-2a509f49f9ae Jun 24 10:08:58 devstack sudo[114220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Flow 'volume_create_manager' (fe3d7140-169e-4901-acec-a32a6db8ac81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc10c18d-4755-4daa-a276-2b0d44f84942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc10c18d-4755-4daa-a276-2b0d44f84942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-308000388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f35c0e3-13f6-4aae-be59-653615734f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f8e15daa79f48c1acc808290c417a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b15a567f-d430-49d4-a5af-a66484b3bf0c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:08:59Z,use_quota=True,user_id='390f9e987eb3462295db081684703760',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559aa752-6c6f-4f80-8692-33bb20ecf707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559aa752-6c6f-4f80-8692-33bb20ecf707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e49fed-54ef-4550-b26d-f7ce7a9ef90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e49fed-54ef-4550-b26d-f7ce7a9ef90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0f35c0e3-13f6-4aae-be59-653615734f7d', 'volume_name': 'volume-0f35c0e3-13f6-4aae-be59-653615734f7d', 'volume_size': 1, 'snapshot_id': 'b15a567f-d430-49d4-a5af-a66484b3bf0c'}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2e6d2a-89e7-4bb9-b692-5e5aee5ffdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2e6d2a-89e7-4bb9-b692-5e5aee5ffdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45011e04-6177-4a41-8ef0-f2b10fdf9168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:08:58 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Volume 0f35c0e3-13f6-4aae-be59-653615734f7d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0f35c0e3-13f6-4aae-be59-653615734f7d', 'volume_size': 1, 'snapshot_id': 'b15a567f-d430-49d4-a5af-a66484b3bf0c'} Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:58 devstack sudo[114217]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713" returned: 0 in 0.792s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] <== create_volume: return (2028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.096s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Acquiring lock "cinder-quobyte-b15a567f-d430-49d4-a5af-a66484b3bf0c-0f35c0e3-13f6-4aae-be59-653615734f7d" by "_create_volume_from_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Lock "cinder-quobyte-b15a567f-d430-49d4-a5af-a66484b3bf0c-0f35c0e3-13f6-4aae-be59-653615734f7d" acquired by "_create_volume_from_snapshot" :: waited 0.091s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Creating volume 0f35c0e3-13f6-4aae-be59-653615734f7d from snapshot b15a567f-d430-49d4-a5af-a66484b3bf0c {{(pid=93447) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:58 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Acquiring lock "cinder-quobyte-0f35c0e3-13f6-4aae-be59-653615734f7d" by "_copy_volume_from_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Attempting download of 24eef098-a286-4809-86c0-dc8d8a815bb2 ((None, [{'url': 'file:///opt/stack/data/glance/images/24eef098-a286-4809-86c0-dc8d8a815bb2', 'metadata': {}}])) to volume 19d28643-a0cd-41d8-9464-5e970cbe3713. {{(pid=93447) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Lock "cinder-quobyte-0f35c0e3-13f6-4aae-be59-653615734f7d" acquired by "_copy_volume_from_snapshot" :: waited 0.077s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] snapshot: b15a567f-d430-49d4-a5af-a66484b3bf0c, volume: 0f35c0e3-13f6-4aae-be59-653615734f7d, {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:08:59 devstack sudo[114220]: pam_unix(sudo:session): session closed for user root Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bb5d36-7cb7-4d26-a28e-24336f19e6eb]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24eef098-a286-4809-86c0-dc8d8a815bb2_t9qw9_bj {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-effa045e-c75b-41d7-b6bd-d622b67a76b7 tempest-CreateVolumesFromImageTest-714115052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-8703a71b-c70a-4eb6-9518-2a509f49f9ae" returned: 0 in 0.971s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac7ed46-b8d1-4c39-8ebb-f846466ea42a]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.b15a567f-d430-49d4-a5af-a66484b3bf0c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-effa045e-c75b-41d7-b6bd-d622b67a76b7 tempest-CreateVolumesFromImageTest-714115052 None] Lock "cinder-quobyte-8703a71b-c70a-4eb6-9518-2a509f49f9ae" released by "delete_volume" :: held 2.207s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:08:59 devstack sudo[114225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24eef098-a286-4809-86c0-dc8d8a815bb2_t9qw9_bj Jun 24 10:08:59 devstack sudo[114225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-effa045e-c75b-41d7-b6bd-d622b67a76b7 tempest-CreateVolumesFromImageTest-714115052 None] Created reservations ['880828c8-60d4-41f1-a843-15fe9b0c56d4', '2924f666-9196-47dc-bccd-baa88bf4751b', '30316a43-7775-4bfc-bc0f-4cb700c0cb32', '89edb28a-88e5-45eb-8ade-a5f9ba3e67c8'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-effa045e-c75b-41d7-b6bd-d622b67a76b7 tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-effa045e-c75b-41d7-b6bd-d622b67a76b7 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-effa045e-c75b-41d7-b6bd-d622b67a76b7 tempest-CreateVolumesFromImageTest-714115052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-effa045e-c75b-41d7-b6bd-d622b67a76b7 tempest-CreateVolumesFromImageTest-714115052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-effa045e-c75b-41d7-b6bd-d622b67a76b7 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:08:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-effa045e-c75b-41d7-b6bd-d622b67a76b7 tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:08:59 devstack sudo[114228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:08:59 devstack sudo[114228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:08:59 devstack sudo[114226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.b15a567f-d430-49d4-a5af-a66484b3bf0c Jun 24 10:08:59 devstack sudo[114226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:00 devstack sudo[114225]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24eef098-a286-4809-86c0-dc8d8a815bb2_t9qw9_bj" returned: 0 in 0.866s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24eef098-a286-4809-86c0-dc8d8a815bb2_t9qw9_bj {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:00 devstack sudo[114233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24eef098-a286-4809-86c0-dc8d8a815bb2_t9qw9_bj Jun 24 10:09:00 devstack sudo[114233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:00 devstack sudo[114226]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.b15a567f-d430-49d4-a5af-a66484b3bf0c" returned: 0 in 1.083s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:00 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-697b60b9-de98-4069-9f1c-db5ccebd0b60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:09:00 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 10:09:00 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Creating direct copy from snapshot {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 10:09:00 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21177d9-2d13-4e13-a259-967e920e61f4]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:00 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9f79b439-aec0-41aa-9cc5-09ed7bad3d02 tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "cinder-60939ce6-e74e-4938-8389-d54b0b00fa4a-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:00 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9f79b439-aec0-41aa-9cc5-09ed7bad3d02 tempest-CreateVolumesFromImageTest-714115052 None] Lock "cinder-60939ce6-e74e-4938-8389-d54b0b00fa4a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:00 devstack sudo[114228]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-effa045e-c75b-41d7-b6bd-d622b67a76b7 tempest-CreateVolumesFromImageTest-714115052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.018s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:00 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-effa045e-c75b-41d7-b6bd-d622b67a76b7 tempest-CreateVolumesFromImageTest-714115052 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:09:00 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-effa045e-c75b-41d7-b6bd-d622b67a76b7 tempest-CreateVolumesFromImageTest-714115052 None] Deleted volume successfully. Jun 24 10:09:00 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9f79b439-aec0-41aa-9cc5-09ed7bad3d02 tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "cinder-quobyte-60939ce6-e74e-4938-8389-d54b0b00fa4a" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:00 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-effa045e-c75b-41d7-b6bd-d622b67a76b7 tempest-CreateVolumesFromImageTest-714115052 None] Lock "cinder-8703a71b-c70a-4eb6-9518-2a509f49f9ae-delete_volume" released by "delete_volume" :: held 3.588s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:00 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9f79b439-aec0-41aa-9cc5-09ed7bad3d02 tempest-CreateVolumesFromImageTest-714115052 None] Lock "cinder-quobyte-60939ce6-e74e-4938-8389-d54b0b00fa4a" acquired by "delete_volume" :: waited 0.033s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:00 devstack sudo[114241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 Jun 24 10:09:00 devstack sudo[114241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:00 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34cc0a7-6de3-4afb-a15b-2521dbff380a]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9f79b439-aec0-41aa-9cc5-09ed7bad3d02 tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-60939ce6-e74e-4938-8389-d54b0b00fa4a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:00 devstack sudo[114243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-60939ce6-e74e-4938-8389-d54b0b00fa4a Jun 24 10:09:00 devstack sudo[114243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:01 devstack sudo[114233]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24eef098-a286-4809-86c0-dc8d8a815bb2_t9qw9_bj" returned: 1 in 1.017s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24eef098-a286-4809-86c0-dc8d8a815bb2_t9qw9_bj' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:09:01 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f5c469-cd07-4f21-8fc8-3990974626e7]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:01 devstack sudo[114248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD Jun 24 10:09:01 devstack sudo[114248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:01 devstack sudo[114243]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9f79b439-aec0-41aa-9cc5-09ed7bad3d02 tempest-CreateVolumesFromImageTest-714115052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-60939ce6-e74e-4938-8389-d54b0b00fa4a" returned: 0 in 0.856s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9f79b439-aec0-41aa-9cc5-09ed7bad3d02 tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-60939ce6-e74e-4938-8389-d54b0b00fa4a {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:01 devstack sudo[114256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-60939ce6-e74e-4938-8389-d54b0b00fa4a Jun 24 10:09:01 devstack sudo[114256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:01 devstack sudo[114241]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60" returned: 0 in 1.099s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:01 devstack cinder-volume[93447]: DEBUG cinder.utils [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Path /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0f35c0e3-13f6-4aae-be59-653615734f7d not found in is_blk_device check {{(pid=93447) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 10:09:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0f35c0e3-13f6-4aae-be59-653615734f7d {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:01 devstack sudo[114258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0f35c0e3-13f6-4aae-be59-653615734f7d Jun 24 10:09:01 devstack sudo[114258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:02 devstack sudo[114248]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD" returned: 0 in 0.905s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:02 devstack sudo[114262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD Jun 24 10:09:02 devstack sudo[114262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:02 devstack sudo[114256]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9f79b439-aec0-41aa-9cc5-09ed7bad3d02 tempest-CreateVolumesFromImageTest-714115052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-60939ce6-e74e-4938-8389-d54b0b00fa4a" returned: 0 in 0.892s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9f79b439-aec0-41aa-9cc5-09ed7bad3d02 tempest-CreateVolumesFromImageTest-714115052 None] Lock "cinder-quobyte-60939ce6-e74e-4938-8389-d54b0b00fa4a" released by "delete_volume" :: held 1.824s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:02 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-9f79b439-aec0-41aa-9cc5-09ed7bad3d02 tempest-CreateVolumesFromImageTest-714115052 None] Created reservations ['02f31552-1b9f-490d-80a7-9d664499087d', '0d9749e6-2e8c-4f84-be84-e850ef0223a4', '9ab8ab75-739f-4a48-b3b5-5c93830bf484', '8cc139f4-8c8b-4d24-91b8-8abdcc84ca48'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:09:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9f79b439-aec0-41aa-9cc5-09ed7bad3d02 tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9f79b439-aec0-41aa-9cc5-09ed7bad3d02 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:02 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9f79b439-aec0-41aa-9cc5-09ed7bad3d02 tempest-CreateVolumesFromImageTest-714115052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:02 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9f79b439-aec0-41aa-9cc5-09ed7bad3d02 tempest-CreateVolumesFromImageTest-714115052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9f79b439-aec0-41aa-9cc5-09ed7bad3d02 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9f79b439-aec0-41aa-9cc5-09ed7bad3d02 tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:02 devstack sudo[114272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:09:02 devstack sudo[114272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-cdacd948-a29e-4fc8-a0c4-3682d66a2438 tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "cinder-139b3c1c-0dfe-4958-9ddb-2d060e4b0e87-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-cdacd948-a29e-4fc8-a0c4-3682d66a2438 tempest-CreateVolumesFromImageTest-714115052 None] Lock "cinder-139b3c1c-0dfe-4958-9ddb-2d060e4b0e87-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:03 devstack sudo[114262]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD" returned: 1 in 1.380s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:09:03 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] 24eef098-a286-4809-86c0-dc8d8a815bb2 was raw, converting to raw {{(pid=93447) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 10:09:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:03 devstack sudo[114287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713 Jun 24 10:09:03 devstack sudo[114287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:03 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-cdacd948-a29e-4fc8-a0c4-3682d66a2438 tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "cinder-quobyte-139b3c1c-0dfe-4958-9ddb-2d060e4b0e87" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:03 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-cdacd948-a29e-4fc8-a0c4-3682d66a2438 tempest-CreateVolumesFromImageTest-714115052 None] Lock "cinder-quobyte-139b3c1c-0dfe-4958-9ddb-2d060e4b0e87" acquired by "delete_volume" :: waited 0.036s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:03 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9938846-77da-4301-921b-ace85bc29954]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cdacd948-a29e-4fc8-a0c4-3682d66a2438 tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-139b3c1c-0dfe-4958-9ddb-2d060e4b0e87 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:04 devstack sudo[114289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-139b3c1c-0dfe-4958-9ddb-2d060e4b0e87 Jun 24 10:09:04 devstack sudo[114289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:04 devstack sudo[114272]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9f79b439-aec0-41aa-9cc5-09ed7bad3d02 tempest-CreateVolumesFromImageTest-714115052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 2.131s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:04 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-9f79b439-aec0-41aa-9cc5-09ed7bad3d02 tempest-CreateVolumesFromImageTest-714115052 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:09:04 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-9f79b439-aec0-41aa-9cc5-09ed7bad3d02 tempest-CreateVolumesFromImageTest-714115052 None] Deleted volume successfully. Jun 24 10:09:04 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9f79b439-aec0-41aa-9cc5-09ed7bad3d02 tempest-CreateVolumesFromImageTest-714115052 None] Lock "cinder-60939ce6-e74e-4938-8389-d54b0b00fa4a-delete_volume" released by "delete_volume" :: held 4.353s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:05 devstack sudo[114287]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713" returned: 0 in 2.311s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:05 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_24eef098-a286-4809-86c0-dc8d8a815bb2_0eak7prtdevstack@QuobyteHD, size 0.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713 {{(pid=93447) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 10:09:05 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Converted 0.00 MB image at 0.00 MB/s Jun 24 10:09:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:05 devstack sudo[114300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713 1G Jun 24 10:09:05 devstack sudo[114300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:05 devstack sudo[114289]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cdacd948-a29e-4fc8-a0c4-3682d66a2438 tempest-CreateVolumesFromImageTest-714115052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-139b3c1c-0dfe-4958-9ddb-2d060e4b0e87" returned: 0 in 2.121s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cdacd948-a29e-4fc8-a0c4-3682d66a2438 tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-139b3c1c-0dfe-4958-9ddb-2d060e4b0e87 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:05 devstack sudo[114302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-139b3c1c-0dfe-4958-9ddb-2d060e4b0e87 Jun 24 10:09:05 devstack sudo[114302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:07 devstack sudo[114300]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713 1G" returned: 0 in 1.392s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:07 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[001e6256-517b-4c47-b89a-0689702aee44]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:07 devstack sudo[114302]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cdacd948-a29e-4fc8-a0c4-3682d66a2438 tempest-CreateVolumesFromImageTest-714115052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-139b3c1c-0dfe-4958-9ddb-2d060e4b0e87" returned: 0 in 1.481s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:07 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-cdacd948-a29e-4fc8-a0c4-3682d66a2438 tempest-CreateVolumesFromImageTest-714115052 None] Lock "cinder-quobyte-139b3c1c-0dfe-4958-9ddb-2d060e4b0e87" released by "delete_volume" :: held 3.735s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:07 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-cdacd948-a29e-4fc8-a0c4-3682d66a2438 tempest-CreateVolumesFromImageTest-714115052 None] Created reservations ['7679a18f-8e7d-4b23-ba34-51192a274712', '46d8c81c-60d4-47e7-9b04-f157a64c2887', '02222b6f-3e4e-4bbb-8e17-d242c1b31633', '4450ddc0-ae52-43be-9f72-57d01e37590f'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:09:07 devstack sudo[114308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713 Jun 24 10:09:07 devstack sudo[114308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cdacd948-a29e-4fc8-a0c4-3682d66a2438 tempest-CreateVolumesFromImageTest-714115052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cdacd948-a29e-4fc8-a0c4-3682d66a2438 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:07 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cdacd948-a29e-4fc8-a0c4-3682d66a2438 tempest-CreateVolumesFromImageTest-714115052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:07 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cdacd948-a29e-4fc8-a0c4-3682d66a2438 tempest-CreateVolumesFromImageTest-714115052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cdacd948-a29e-4fc8-a0c4-3682d66a2438 tempest-CreateVolumesFromImageTest-714115052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:07 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cdacd948-a29e-4fc8-a0c4-3682d66a2438 tempest-CreateVolumesFromImageTest-714115052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:07 devstack sudo[114310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:09:07 devstack sudo[114310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:08 devstack sudo[114258]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0f35c0e3-13f6-4aae-be59-653615734f7d" returned: 0 in 7.351s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:08 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adff50e-8606-44e1-8c44-9db8caa31397]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:09 devstack sudo[114308]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713" returned: 0 in 1.736s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:09 devstack sudo[114314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 Jun 24 10:09:09 devstack sudo[114314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:09 devstack sudo[114310]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cdacd948-a29e-4fc8-a0c4-3682d66a2438 tempest-CreateVolumesFromImageTest-714115052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.342s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:09 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-cdacd948-a29e-4fc8-a0c4-3682d66a2438 tempest-CreateVolumesFromImageTest-714115052 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:09:09 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-cdacd948-a29e-4fc8-a0c4-3682d66a2438 tempest-CreateVolumesFromImageTest-714115052 None] Deleted volume successfully. Jun 24 10:09:09 devstack sudo[114316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713 Jun 24 10:09:09 devstack sudo[114316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:09 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-cdacd948-a29e-4fc8-a0c4-3682d66a2438 tempest-CreateVolumesFromImageTest-714115052 None] Lock "cinder-139b3c1c-0dfe-4958-9ddb-2d060e4b0e87-delete_volume" released by "delete_volume" :: held 6.219s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:10 devstack sudo[114316]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713" returned: 1 in 1.127s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:09:10 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Downloaded image 24eef098-a286-4809-86c0-dc8d8a815bb2 ((None, [{'url': 'file:///opt/stack/data/glance/images/24eef098-a286-4809-86c0-dc8d8a815bb2', 'metadata': {}}])) to volume 19d28643-a0cd-41d8-9464-5e970cbe3713 successfully. {{(pid=93447) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 10:09:10 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Temporary image 24eef098-a286-4809-86c0-dc8d8a815bb2 for user 4eecfa6eb4324a67bfdd562c2435443a is deleted. {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 10:09:10 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Marking volume 19d28643-a0cd-41d8-9464-5e970cbe3713 as bootable. {{(pid=93447) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 10:09:10 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Copying metadata from image 24eef098-a286-4809-86c0-dc8d8a815bb2 to 19d28643-a0cd-41d8-9464-5e970cbe3713. {{(pid=93447) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 10:09:10 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Creating volume glance metadata for volume 19d28643-a0cd-41d8-9464-5e970cbe3713 backed by image 24eef098-a286-4809-86c0-dc8d8a815bb2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '24eef098-a286-4809-86c0-dc8d8a815bb2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '84453985479eb8bf5126fb95cda34919', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93447) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 10:09:10 devstack sudo[114314]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60" returned: 0 in 1.353s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:10 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60, size 1024.00 MB, duration 7.35 sec, destination /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0f35c0e3-13f6-4aae-be59-653615734f7d {{(pid=93447) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 10:09:10 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Converted 1024.00 MB image at 139.28 MB/s Jun 24 10:09:10 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0f35c0e3-13f6-4aae-be59-653615734f7d is being set with open permissions: ugo+rw Jun 24 10:09:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0f35c0e3-13f6-4aae-be59-653615734f7d {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:10 devstack sudo[114325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0f35c0e3-13f6-4aae-be59-653615734f7d Jun 24 10:09:10 devstack sudo[114325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16e81d8-0931-467e-9c38-68deeb847890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19d28643-a0cd-41d8-9464-5e970cbe3713', 'volume_size': 1, 'image_id': '24eef098-a286-4809-86c0-dc8d8a815bb2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24eef098-a286-4809-86c0-dc8d8a815bb2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '84453985479eb8bf5126fb95cda34919', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e6058ca5598e4a6b84a11109517ba1bf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '760398fa431109ba16bee952c028b88705641b4953a459e493e863bc83795ab2c8ef202c2dfa30226f08045850f087ab914e03a776c27e89eec71c4869b2f903', 'id': '24eef098-a286-4809-86c0-dc8d8a815bb2', 'created_at': datetime.datetime(2026, 6, 24, 8, 8, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 8, 8, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24eef098-a286-4809-86c0-dc8d8a815bb2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f86d459-50e2-40dd-b94e-ef289a9cccbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:10 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Volume volume-19d28643-a0cd-41d8-9464-5e970cbe3713 (19d28643-a0cd-41d8-9464-5e970cbe3713): created successfully Jun 24 10:09:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f86d459-50e2-40dd-b94e-ef289a9cccbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Flow 'volume_create_manager' (edfe3368-d1ca-4f50-9af9-bfc8e867be11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:09:10 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-27ab182d-06ea-4908-a321-b03580ba4579 tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Created volume successfully. Jun 24 10:09:10 devstack sudo[114325]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0f35c0e3-13f6-4aae-be59-653615734f7d" returned: 0 in 0.733s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:10 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Lock "cinder-quobyte-0f35c0e3-13f6-4aae-be59-653615734f7d" released by "_copy_volume_from_snapshot" :: held 11.853s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:10 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Lock "cinder-quobyte-b15a567f-d430-49d4-a5af-a66484b3bf0c-0f35c0e3-13f6-4aae-be59-653615734f7d" released by "_create_volume_from_snapshot" :: held 11.992s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.087s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45011e04-6177-4a41-8ef0-f2b10fdf9168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f35c0e3-13f6-4aae-be59-653615734f7d', 'volume_size': 1, 'snapshot_id': 'b15a567f-d430-49d4-a5af-a66484b3bf0c'}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1efcf4-8cf9-4442-b1f3-21e1c2b55ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:11 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Volume volume-0f35c0e3-13f6-4aae-be59-653615734f7d (0f35c0e3-13f6-4aae-be59-653615734f7d): created successfully Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e1efcf4-8cf9-4442-b1f3-21e1c2b55ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Flow 'volume_create_manager' (fe3d7140-169e-4901-acec-a32a6db8ac81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:09:11 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-bf9d329a-fac4-4238-a592-4131ab43b449 tempest-VolumeDependencyTests-1737952209 None] Created volume successfully. Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f0c2d0c5-bcef-4e2c-8106-85f198cb511a tempest-VolumeDependencyTests-1737952209 None] Acquiring lock "cinder-b15a567f-d430-49d4-a5af-a66484b3bf0c-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f0c2d0c5-bcef-4e2c-8106-85f198cb511a tempest-VolumeDependencyTests-1737952209 None] Lock "cinder-b15a567f-d430-49d4-a5af-a66484b3bf0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f0c2d0c5-bcef-4e2c-8106-85f198cb511a tempest-VolumeDependencyTests-1737952209 None] Acquiring lock "cinder-quobyte-697b60b9-de98-4069-9f1c-db5ccebd0b60" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f0c2d0c5-bcef-4e2c-8106-85f198cb511a tempest-VolumeDependencyTests-1737952209 None] Lock "cinder-quobyte-697b60b9-de98-4069-9f1c-db5ccebd0b60" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f0c2d0c5-bcef-4e2c-8106-85f198cb511a tempest-VolumeDependencyTests-1737952209 None] Acquiring lock "cinder-quobyte-b15a567f-d430-49d4-a5af-a66484b3bf0c" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f0c2d0c5-bcef-4e2c-8106-85f198cb511a tempest-VolumeDependencyTests-1737952209 None] Lock "cinder-quobyte-b15a567f-d430-49d4-a5af-a66484b3bf0c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-f0c2d0c5-bcef-4e2c-8106-85f198cb511a tempest-VolumeDependencyTests-1737952209 None] Deleting offline snapshot b15a567f-d430-49d4-a5af-a66484b3bf0c of volume 697b60b9-de98-4069-9f1c-db5ccebd0b60 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-f0c2d0c5-bcef-4e2c-8106-85f198cb511a tempest-VolumeDependencyTests-1737952209 None] snapshot_file for this snap is: volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.b15a567f-d430-49d4-a5af-a66484b3bf0c {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[66961dc4-fd90-4cef-9f6d-92f38e74ff4c]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f0c2d0c5-bcef-4e2c-8106-85f198cb511a tempest-VolumeDependencyTests-1737952209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.b15a567f-d430-49d4-a5af-a66484b3bf0c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-cf7393af-098d-44f7-ab18-668dcefc210f tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Acquiring lock "cinder-19d28643-a0cd-41d8-9464-5e970cbe3713-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:11 devstack sudo[114328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.b15a567f-d430-49d4-a5af-a66484b3bf0c Jun 24 10:09:11 devstack sudo[114328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-cf7393af-098d-44f7-ab18-668dcefc210f tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Lock "cinder-19d28643-a0cd-41d8-9464-5e970cbe3713-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-cf7393af-098d-44f7-ab18-668dcefc210f tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Acquiring lock "cinder-quobyte-19d28643-a0cd-41d8-9464-5e970cbe3713" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-cf7393af-098d-44f7-ab18-668dcefc210f tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Lock "cinder-quobyte-19d28643-a0cd-41d8-9464-5e970cbe3713" acquired by "delete_volume" :: waited 0.017s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb10b93-cdb9-426e-bec8-c64c09d2b2e3]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cf7393af-098d-44f7-ab18-668dcefc210f tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Flow 'volume_create_manager' (8181bf06-cb7d-4314-841f-6d952e91ab07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a63b47d5-1ffb-4a15-9164-9ada1fbf0bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:11 devstack sudo[114330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713 Jun 24 10:09:11 devstack sudo[114330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a63b47d5-1ffb-4a15-9164-9ada1fbf0bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1725431352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddfd5f50-88de-4268-b8e1-f9578cc9c485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ee7892f53b4f59a25111dbd5f636d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:09:12Z,use_quota=True,user_id='f3976f7f25014ee0a4ef07e8ae2e245f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (183f7ac4-4751-4fdd-8d27-962e51b073fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (183f7ac4-4751-4fdd-8d27-962e51b073fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a75832-1686-47b6-bfa3-4d50a4a7c458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a75832-1686-47b6-bfa3-4d50a4a7c458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddfd5f50-88de-4268-b8e1-f9578cc9c485', 'volume_name': 'volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8898918-3889-423a-bb29-88620ecfaf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8898918-3889-423a-bb29-88620ecfaf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a8adcc-9fb8-480e-bf9c-0d303bf3dcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:11 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Volume ddfd5f50-88de-4268-b8e1-f9578cc9c485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485', 'volume_size': 1} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1725431352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddfd5f50-88de-4268-b8e1-f9578cc9c485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ee7892f53b4f59a25111dbd5f636d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:09:12Z,use_quota=True,user_id='f3976f7f25014ee0a4ef07e8ae2e245f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Creating volume ddfd5f50-88de-4268-b8e1-f9578cc9c485 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:09:11 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:09:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:11 devstack sudo[114332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 1073741824 Jun 24 10:09:11 devstack sudo[114332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:12 devstack sudo[114328]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f0c2d0c5-bcef-4e2c-8106-85f198cb511a tempest-VolumeDependencyTests-1737952209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.b15a567f-d430-49d4-a5af-a66484b3bf0c" returned: 0 in 1.072s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-f0c2d0c5-bcef-4e2c-8106-85f198cb511a tempest-VolumeDependencyTests-1737952209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-697b60b9-de98-4069-9f1c-db5ccebd0b60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:09:12 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e7c8cb-1595-475e-b9d1-0858b3bfa0f8]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f0c2d0c5-bcef-4e2c-8106-85f198cb511a tempest-VolumeDependencyTests-1737952209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:12 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:09:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Flow 'volume_create_manager' (2ee618eb-2990-45dc-9d6f-0e5773e2e4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:09:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58111c87-711e-4c75-a10e-e7f49ebe4a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58111c87-711e-4c75-a10e-e7f49ebe4a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1611906789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7811a67d-2813-424d-a617-3a0451072ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5543b685553448c3b4c1dcadeda1c861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:09:12Z,use_quota=True,user_id='8565dd4e36334446bf50a503828b5b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc58824c-bf92-4714-b516-554581d4c650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc58824c-bf92-4714-b516-554581d4c650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3edc79af-31da-4f3b-bec2-86c29439f5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3edc79af-31da-4f3b-bec2-86c29439f5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7811a67d-2813-424d-a617-3a0451072ff0', 'volume_name': 'volume-7811a67d-2813-424d-a617-3a0451072ff0', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:12 devstack sudo[114338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 Jun 24 10:09:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0ee41c-bdc9-45e3-850e-65428995b96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:12 devstack sudo[114338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0ee41c-bdc9-45e3-850e-65428995b96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1936e13a-45f3-4e32-b487-9194f90b10a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:12 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Volume 7811a67d-2813-424d-a617-3a0451072ff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7811a67d-2813-424d-a617-3a0451072ff0', 'volume_size': 1} Jun 24 10:09:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:12 devstack sudo[114330]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cf7393af-098d-44f7-ab18-668dcefc210f tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713" returned: 0 in 1.009s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cf7393af-098d-44f7-ab18-668dcefc210f tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:12 devstack sudo[114344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713 Jun 24 10:09:12 devstack sudo[114344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:12 devstack sudo[114332]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 1073741824" returned: 0 in 1.096s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:13 devstack sudo[114347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 Jun 24 10:09:13 devstack sudo[114347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:13 devstack sudo[114338]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f0c2d0c5-bcef-4e2c-8106-85f198cb511a tempest-VolumeDependencyTests-1737952209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60" returned: 0 in 0.830s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f0c2d0c5-bcef-4e2c-8106-85f198cb511a tempest-VolumeDependencyTests-1737952209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.b15a567f-d430-49d4-a5af-a66484b3bf0c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:13 devstack sudo[114352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.b15a567f-d430-49d4-a5af-a66484b3bf0c Jun 24 10:09:13 devstack sudo[114352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:13 devstack sudo[114344]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cf7393af-098d-44f7-ab18-668dcefc210f tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713" returned: 1 in 0.873s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cf7393af-098d-44f7-ab18-668dcefc210f tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:09:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cf7393af-098d-44f7-ab18-668dcefc210f tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:13 devstack sudo[114357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713 Jun 24 10:09:13 devstack sudo[114357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:13 devstack sudo[114347]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485" returned: 0 in 0.687s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:09:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.120s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1611906789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7811a67d-2813-424d-a617-3a0451072ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5543b685553448c3b4c1dcadeda1c861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:09:12Z,use_quota=True,user_id='8565dd4e36334446bf50a503828b5b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:09:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Creating volume 7811a67d-2813-424d-a617-3a0451072ff0 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:09:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:13 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:09:13 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:09:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a8adcc-9fb8-480e-bf9c-0d303bf3dcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b114e5ff-9b9b-40c4-b224-d5beaca7aad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:13 devstack sudo[114360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0 1073741824 Jun 24 10:09:13 devstack sudo[114360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:13 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Volume volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 (ddfd5f50-88de-4268-b8e1-f9578cc9c485): created successfully Jun 24 10:09:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b114e5ff-9b9b-40c4-b224-d5beaca7aad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:13 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Flow 'volume_create_manager' (8181bf06-cb7d-4314-841f-6d952e91ab07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:09:13 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-91d2f775-678a-48ec-89b6-08f41db9e251 tempest-SnapshotDependencyTests-129623090 None] Created volume successfully. Jun 24 10:09:14 devstack sudo[114352]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f0c2d0c5-bcef-4e2c-8106-85f198cb511a tempest-VolumeDependencyTests-1737952209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.b15a567f-d430-49d4-a5af-a66484b3bf0c" returned: 0 in 0.815s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f0c2d0c5-bcef-4e2c-8106-85f198cb511a tempest-VolumeDependencyTests-1737952209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.b15a567f-d430-49d4-a5af-a66484b3bf0c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:14 devstack sudo[114365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.b15a567f-d430-49d4-a5af-a66484b3bf0c Jun 24 10:09:14 devstack sudo[114365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:14 devstack sudo[114357]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cf7393af-098d-44f7-ab18-668dcefc210f tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-19d28643-a0cd-41d8-9464-5e970cbe3713" returned: 0 in 0.792s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:14 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-cf7393af-098d-44f7-ab18-668dcefc210f tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Lock "cinder-quobyte-19d28643-a0cd-41d8-9464-5e970cbe3713" released by "delete_volume" :: held 2.766s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:14 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-cf7393af-098d-44f7-ab18-668dcefc210f tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Created reservations ['d80111e7-adb6-439a-b314-0f4966da8af8', '48ab3047-d689-4f1a-ae64-efbe22209c8b', 'f20c7c39-3914-4919-b608-eca6e43553a4', '0902f591-4008-481e-8ffa-c86282466a58'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:09:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cf7393af-098d-44f7-ab18-668dcefc210f tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cf7393af-098d-44f7-ab18-668dcefc210f tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:14 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cf7393af-098d-44f7-ab18-668dcefc210f tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:14 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cf7393af-098d-44f7-ab18-668dcefc210f tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cf7393af-098d-44f7-ab18-668dcefc210f tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cf7393af-098d-44f7-ab18-668dcefc210f tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:14 devstack sudo[114371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:09:14 devstack sudo[114371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:14 devstack sudo[114360]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0 1073741824" returned: 0 in 0.975s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:14 devstack sudo[114374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0 Jun 24 10:09:14 devstack sudo[114374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:14 devstack sudo[114365]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f0c2d0c5-bcef-4e2c-8106-85f198cb511a tempest-VolumeDependencyTests-1737952209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60.b15a567f-d430-49d4-a5af-a66484b3bf0c" returned: 0 in 0.779s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:14 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f0c2d0c5-bcef-4e2c-8106-85f198cb511a tempest-VolumeDependencyTests-1737952209 None] Lock "cinder-quobyte-b15a567f-d430-49d4-a5af-a66484b3bf0c" released by "_delete_snapshot" :: held 3.658s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:14 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f0c2d0c5-bcef-4e2c-8106-85f198cb511a tempest-VolumeDependencyTests-1737952209 None] Lock "cinder-quobyte-697b60b9-de98-4069-9f1c-db5ccebd0b60" released by "delete_snapshot" :: held 3.689s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:15 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-f0c2d0c5-bcef-4e2c-8106-85f198cb511a tempest-VolumeDependencyTests-1737952209 None] Created reservations ['9fddf761-b24e-4a47-a259-06c6da199724', '33a90023-4ac1-44b5-a5c1-41c9645f206b', '8a402244-d163-41c1-a06f-9a0a29d60d39', 'c26e05e8-69f4-4601-a02e-d5e41cdd894d'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:09:15 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-f0c2d0c5-bcef-4e2c-8106-85f198cb511a tempest-VolumeDependencyTests-1737952209 None] Delete snapshot completed successfully. Jun 24 10:09:15 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f0c2d0c5-bcef-4e2c-8106-85f198cb511a tempest-VolumeDependencyTests-1737952209 None] Lock "cinder-b15a567f-d430-49d4-a5af-a66484b3bf0c-delete_snapshot" released by "delete_snapshot" :: held 4.064s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-63faf344-44b8-4db9-a7a4-b0ee6e8ae3f9 tempest-SnapshotDependencyTests-129623090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:15 devstack sudo[114371]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cf7393af-098d-44f7-ab18-668dcefc210f tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.878s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:15 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-cf7393af-098d-44f7-ab18-668dcefc210f tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:09:15 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-cf7393af-098d-44f7-ab18-668dcefc210f tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Deleted volume successfully. Jun 24 10:09:15 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-cf7393af-098d-44f7-ab18-668dcefc210f tempest-VolumeAndVolumeTypeFromImageTest-1929325657 None] Lock "cinder-19d28643-a0cd-41d8-9464-5e970cbe3713-delete_volume" released by "delete_volume" :: held 3.898s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:15 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ba06566b-1267-4e2e-8b7f-50504bbd6cd3 tempest-VolumeDependencyTests-1737952209 None] Acquiring lock "cinder-697b60b9-de98-4069-9f1c-db5ccebd0b60-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:15 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ba06566b-1267-4e2e-8b7f-50504bbd6cd3 tempest-VolumeDependencyTests-1737952209 None] Lock "cinder-697b60b9-de98-4069-9f1c-db5ccebd0b60-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:15 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ba06566b-1267-4e2e-8b7f-50504bbd6cd3 tempest-VolumeDependencyTests-1737952209 None] Acquiring lock "cinder-quobyte-697b60b9-de98-4069-9f1c-db5ccebd0b60" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:15 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ba06566b-1267-4e2e-8b7f-50504bbd6cd3 tempest-VolumeDependencyTests-1737952209 None] Lock "cinder-quobyte-697b60b9-de98-4069-9f1c-db5ccebd0b60" acquired by "delete_volume" :: waited 0.030s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:15 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[6907ace0-613d-408e-b65b-b75c40df2865]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ba06566b-1267-4e2e-8b7f-50504bbd6cd3 tempest-VolumeDependencyTests-1737952209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:15 devstack sudo[114374]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0" returned: 0 in 0.918s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:15 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] <== create_volume: return (1963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:09:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-63faf344-44b8-4db9-a7a4-b0ee6e8ae3f9 tempest-SnapshotDependencyTests-129623090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.393s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1936e13a-45f3-4e32-b487-9194f90b10a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7811a67d-2813-424d-a617-3a0451072ff0', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b4a7b9-f9ce-4895-ab2d-d635f8dea3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:15 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-63faf344-44b8-4db9-a7a4-b0ee6e8ae3f9 tempest-SnapshotDependencyTests-129623090 None] Creating offline snapshot 08bd3405-0a5f-49c6-8c45-21d1ff5522bd of volume ddfd5f50-88de-4268-b8e1-f9578cc9c485 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 10:09:15 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Volume volume-7811a67d-2813-424d-a617-3a0451072ff0 (7811a67d-2813-424d-a617-3a0451072ff0): created successfully Jun 24 10:09:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0b4a7b9-f9ce-4895-ab2d-d635f8dea3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Flow 'volume_create_manager' (2ee618eb-2990-45dc-9d6f-0e5773e2e4c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:09:15 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[80822212-bb1c-418d-9772-f1f06b2cfde7]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:15 devstack sudo[114378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 Jun 24 10:09:15 devstack sudo[114378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-63faf344-44b8-4db9-a7a4-b0ee6e8ae3f9 tempest-SnapshotDependencyTests-129623090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:15 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-29f7380d-19d2-44d1-97e9-e9cd0857030d tempest-CreateVolumesFromSnapshotTest-883770034 None] Created volume successfully. Jun 24 10:09:15 devstack sudo[114380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 Jun 24 10:09:15 devstack sudo[114380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:16 devstack sudo[114378]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ba06566b-1267-4e2e-8b7f-50504bbd6cd3 tempest-VolumeDependencyTests-1737952209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60" returned: 0 in 0.960s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ba06566b-1267-4e2e-8b7f-50504bbd6cd3 tempest-VolumeDependencyTests-1737952209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:16 devstack sudo[114389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60 Jun 24 10:09:16 devstack sudo[114389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:16 devstack sudo[114380]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-63faf344-44b8-4db9-a7a4-b0ee6e8ae3f9 tempest-SnapshotDependencyTests-129623090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485" returned: 0 in 0.988s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-63faf344-44b8-4db9-a7a4-b0ee6e8ae3f9 tempest-SnapshotDependencyTests-129623090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.08bd3405-0a5f-49c6-8c45-21d1ff5522bd 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:16 devstack sudo[114391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.08bd3405-0a5f-49c6-8c45-21d1ff5522bd 1G Jun 24 10:09:16 devstack sudo[114391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-460a4ff4-0a45-44af-b4cb-a91b3b287cd1 tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:17 devstack sudo[114389]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ba06566b-1267-4e2e-8b7f-50504bbd6cd3 tempest-VolumeDependencyTests-1737952209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-697b60b9-de98-4069-9f1c-db5ccebd0b60" returned: 0 in 0.803s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:17 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ba06566b-1267-4e2e-8b7f-50504bbd6cd3 tempest-VolumeDependencyTests-1737952209 None] Lock "cinder-quobyte-697b60b9-de98-4069-9f1c-db5ccebd0b60" released by "delete_volume" :: held 1.839s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:17 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-ba06566b-1267-4e2e-8b7f-50504bbd6cd3 tempest-VolumeDependencyTests-1737952209 None] Created reservations ['fd875868-4c5a-4f70-b3ce-eaf0f072ff8c', '97f8d5f1-1352-4056-9b06-2f3492bec1ff', '2fd768ca-1084-4275-ac49-7c0a11e25db6', '03867d51-26d1-41a9-9c78-7e4907ccd086'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:09:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ba06566b-1267-4e2e-8b7f-50504bbd6cd3 tempest-VolumeDependencyTests-1737952209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ba06566b-1267-4e2e-8b7f-50504bbd6cd3 tempest-VolumeDependencyTests-1737952209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:17 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ba06566b-1267-4e2e-8b7f-50504bbd6cd3 tempest-VolumeDependencyTests-1737952209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:17 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-ba06566b-1267-4e2e-8b7f-50504bbd6cd3 tempest-VolumeDependencyTests-1737952209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-ba06566b-1267-4e2e-8b7f-50504bbd6cd3 tempest-VolumeDependencyTests-1737952209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ba06566b-1267-4e2e-8b7f-50504bbd6cd3 tempest-VolumeDependencyTests-1737952209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:17 devstack sudo[114396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:09:17 devstack sudo[114396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:17 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-40900c3a-b97a-4464-899e-39514ddbb457 tempest-VolumeDependencyTests-1737952209 None] Acquiring lock "cinder-0f35c0e3-13f6-4aae-be59-653615734f7d-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:17 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-40900c3a-b97a-4464-899e-39514ddbb457 tempest-VolumeDependencyTests-1737952209 None] Lock "cinder-0f35c0e3-13f6-4aae-be59-653615734f7d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:17 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-40900c3a-b97a-4464-899e-39514ddbb457 tempest-VolumeDependencyTests-1737952209 None] Acquiring lock "cinder-quobyte-0f35c0e3-13f6-4aae-be59-653615734f7d" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:17 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-40900c3a-b97a-4464-899e-39514ddbb457 tempest-VolumeDependencyTests-1737952209 None] Lock "cinder-quobyte-0f35c0e3-13f6-4aae-be59-653615734f7d" acquired by "delete_volume" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:17 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8914026a-a4da-4396-b67f-a4dcd1a7ede6]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-40900c3a-b97a-4464-899e-39514ddbb457 tempest-VolumeDependencyTests-1737952209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0f35c0e3-13f6-4aae-be59-653615734f7d {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:18 devstack sudo[114391]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-63faf344-44b8-4db9-a7a4-b0ee6e8ae3f9 tempest-SnapshotDependencyTests-129623090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.08bd3405-0a5f-49c6-8c45-21d1ff5522bd 1G" returned: 0 in 1.242s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-63faf344-44b8-4db9-a7a4-b0ee6e8ae3f9 tempest-SnapshotDependencyTests-129623090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.08bd3405-0a5f-49c6-8c45-21d1ff5522bd {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:18 devstack sudo[114401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.08bd3405-0a5f-49c6-8c45-21d1ff5522bd Jun 24 10:09:18 devstack sudo[114401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:18 devstack sudo[114400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0f35c0e3-13f6-4aae-be59-653615734f7d Jun 24 10:09:18 devstack sudo[114400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:18 devstack sudo[114396]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-ba06566b-1267-4e2e-8b7f-50504bbd6cd3 tempest-VolumeDependencyTests-1737952209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.918s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:18 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-ba06566b-1267-4e2e-8b7f-50504bbd6cd3 tempest-VolumeDependencyTests-1737952209 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:09:18 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-ba06566b-1267-4e2e-8b7f-50504bbd6cd3 tempest-VolumeDependencyTests-1737952209 None] Deleted volume successfully. Jun 24 10:09:18 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-ba06566b-1267-4e2e-8b7f-50504bbd6cd3 tempest-VolumeDependencyTests-1737952209 None] Lock "cinder-697b60b9-de98-4069-9f1c-db5ccebd0b60-delete_volume" released by "delete_volume" :: held 3.031s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:18 devstack sudo[114401]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-63faf344-44b8-4db9-a7a4-b0ee6e8ae3f9 tempest-SnapshotDependencyTests-129623090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.08bd3405-0a5f-49c6-8c45-21d1ff5522bd" returned: 0 in 0.890s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:18 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-63faf344-44b8-4db9-a7a4-b0ee6e8ae3f9 tempest-SnapshotDependencyTests-129623090 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.08bd3405-0a5f-49c6-8c45-21d1ff5522bd is being set with open permissions: ugo+rw Jun 24 10:09:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-63faf344-44b8-4db9-a7a4-b0ee6e8ae3f9 tempest-SnapshotDependencyTests-129623090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.08bd3405-0a5f-49c6-8c45-21d1ff5522bd {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:18 devstack sudo[114411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.08bd3405-0a5f-49c6-8c45-21d1ff5522bd Jun 24 10:09:18 devstack sudo[114411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:18 devstack sudo[114400]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-40900c3a-b97a-4464-899e-39514ddbb457 tempest-VolumeDependencyTests-1737952209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0f35c0e3-13f6-4aae-be59-653615734f7d" returned: 0 in 1.028s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-40900c3a-b97a-4464-899e-39514ddbb457 tempest-VolumeDependencyTests-1737952209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0f35c0e3-13f6-4aae-be59-653615734f7d {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:19 devstack sudo[114413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0f35c0e3-13f6-4aae-be59-653615734f7d Jun 24 10:09:19 devstack sudo[114413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:19 devstack sudo[114411]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-63faf344-44b8-4db9-a7a4-b0ee6e8ae3f9 tempest-SnapshotDependencyTests-129623090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.08bd3405-0a5f-49c6-8c45-21d1ff5522bd" returned: 0 in 0.685s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:19 devstack sudo[114413]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-63faf344-44b8-4db9-a7a4-b0ee6e8ae3f9 tempest-SnapshotDependencyTests-129623090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-40900c3a-b97a-4464-899e-39514ddbb457 tempest-VolumeDependencyTests-1737952209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-0f35c0e3-13f6-4aae-be59-653615734f7d" returned: 0 in 0.683s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:19 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-40900c3a-b97a-4464-899e-39514ddbb457 tempest-VolumeDependencyTests-1737952209 None] Lock "cinder-quobyte-0f35c0e3-13f6-4aae-be59-653615734f7d" released by "delete_volume" :: held 1.768s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:19 devstack sudo[114417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.info Jun 24 10:09:19 devstack sudo[114417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:19 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-40900c3a-b97a-4464-899e-39514ddbb457 tempest-VolumeDependencyTests-1737952209 None] Created reservations ['acd77223-3bae-4876-9834-e22ddccbe554', '09256259-da2c-45bc-b0ba-c1b536fdb086', '06f93953-08c1-40dd-851b-c282d5999835', '65c9e150-d308-41b3-9e83-deccd4062399'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:09:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-40900c3a-b97a-4464-899e-39514ddbb457 tempest-VolumeDependencyTests-1737952209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-40900c3a-b97a-4464-899e-39514ddbb457 tempest-VolumeDependencyTests-1737952209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:19 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-40900c3a-b97a-4464-899e-39514ddbb457 tempest-VolumeDependencyTests-1737952209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:19 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-40900c3a-b97a-4464-899e-39514ddbb457 tempest-VolumeDependencyTests-1737952209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-40900c3a-b97a-4464-899e-39514ddbb457 tempest-VolumeDependencyTests-1737952209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-40900c3a-b97a-4464-899e-39514ddbb457 tempest-VolumeDependencyTests-1737952209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:19 devstack sudo[114419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:09:19 devstack sudo[114419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:20 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:09:20 devstack sudo[114419]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:20 devstack sudo[114417]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:20 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Flow 'volume_create_manager' (ff6403f5-cabb-4d0d-b50c-666f2ba9d7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:09:20 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bff872c-5a55-4bcd-8a17-fbddc310a4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-40900c3a-b97a-4464-899e-39514ddbb457 tempest-VolumeDependencyTests-1737952209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.753s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-63faf344-44b8-4db9-a7a4-b0ee6e8ae3f9 tempest-SnapshotDependencyTests-129623090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.info" returned: 0 in 0.906s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:20 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-40900c3a-b97a-4464-899e-39514ddbb457 tempest-VolumeDependencyTests-1737952209 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:09:20 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-63faf344-44b8-4db9-a7a4-b0ee6e8ae3f9 tempest-SnapshotDependencyTests-129623090 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.info is being set with open permissions: ugo+rw Jun 24 10:09:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-63faf344-44b8-4db9-a7a4-b0ee6e8ae3f9 tempest-SnapshotDependencyTests-129623090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:20 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bff872c-5a55-4bcd-8a17-fbddc310a4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a549dab1-ac64-46ad-91f9-15724615756c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b9282d86c8b40c89e832e543d5f262c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:09:20Z,use_quota=True,user_id='4f0ace47d3394fee882d0fd3eb8ee433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:20 devstack sudo[114423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.info Jun 24 10:09:20 devstack sudo[114423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:20 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb77be0-75ef-49bf-a57b-fc3ca1f6ae18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:20 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb77be0-75ef-49bf-a57b-fc3ca1f6ae18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:20 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d999df-1d56-45d0-85dc-0e9e78e6b588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:20 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66d999df-1d56-45d0-85dc-0e9e78e6b588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a549dab1-ac64-46ad-91f9-15724615756c', 'volume_name': 'volume-a549dab1-ac64-46ad-91f9-15724615756c', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:20 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f543da4-14b7-455b-a91c-4f133e64550e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:20 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f543da4-14b7-455b-a91c-4f133e64550e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:20 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d45292a-4770-4c81-80d3-dd594cd780cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:20 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Volume a549dab1-ac64-46ad-91f9-15724615756c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a549dab1-ac64-46ad-91f9-15724615756c', 'volume_size': 1} Jun 24 10:09:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:20 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-40900c3a-b97a-4464-899e-39514ddbb457 tempest-VolumeDependencyTests-1737952209 None] Deleted volume successfully. Jun 24 10:09:20 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-40900c3a-b97a-4464-899e-39514ddbb457 tempest-VolumeDependencyTests-1737952209 None] Lock "cinder-0f35c0e3-13f6-4aae-be59-653615734f7d-delete_volume" released by "delete_volume" :: held 2.803s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:21 devstack sudo[114423]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-63faf344-44b8-4db9-a7a4-b0ee6e8ae3f9 tempest-SnapshotDependencyTests-129623090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.info" returned: 0 in 0.759s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-63faf344-44b8-4db9-a7a4-b0ee6e8ae3f9 tempest-SnapshotDependencyTests-129623090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.618s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-460a4ff4-0a45-44af-b4cb-a91b3b287cd1 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.244s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:21 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-460a4ff4-0a45-44af-b4cb-a91b3b287cd1 tempest-CreateVolumesFromSnapshotTest-883770034 None] Creating offline snapshot 31783c1c-55e4-4d2b-bcec-f24ef0808407 of volume 7811a67d-2813-424d-a617-3a0451072ff0 {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 10:09:21 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-63faf344-44b8-4db9-a7a4-b0ee6e8ae3f9 tempest-SnapshotDependencyTests-129623090 None] Create snapshot completed successfully Jun 24 10:09:21 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96775e4-7242-4d2a-be48-20569907b28d]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-460a4ff4-0a45-44af-b4cb-a91b3b287cd1 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:21 devstack sudo[114426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0 Jun 24 10:09:21 devstack sudo[114426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:22 devstack sudo[114426]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-460a4ff4-0a45-44af-b4cb-a91b3b287cd1 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0" returned: 0 in 0.977s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-460a4ff4-0a45-44af-b4cb-a91b3b287cd1 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.31783c1c-55e4-4d2b-bcec-f24ef0808407 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:22 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:09:22 devstack sudo[114432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.31783c1c-55e4-4d2b-bcec-f24ef0808407 1G Jun 24 10:09:22 devstack sudo[114432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:22 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Flow 'volume_create_manager' (656d7341-9e64-47a8-a51e-c225c359720e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:09:22 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b7f1d8f-6f08-420e-95ba-154cb0a89d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:22 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b7f1d8f-6f08-420e-95ba-154cb0a89d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c139d87d-a256-4cc1-a571-783184eed481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ee7892f53b4f59a25111dbd5f636d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=08bd3405-0a5f-49c6-8c45-21d1ff5522bd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:09:22Z,use_quota=True,user_id='f3976f7f25014ee0a4ef07e8ae2e245f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:22 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c62af68d-906c-4fd8-8671-c5e5980091d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:22 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c62af68d-906c-4fd8-8671-c5e5980091d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:22 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9393f70a-ed0e-4c6a-93cb-1f6c3fe27e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:22 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9393f70a-ed0e-4c6a-93cb-1f6c3fe27e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c139d87d-a256-4cc1-a571-783184eed481', 'volume_name': 'volume-c139d87d-a256-4cc1-a571-783184eed481', 'volume_size': 1, 'snapshot_id': '08bd3405-0a5f-49c6-8c45-21d1ff5522bd'}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:22 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99155d5c-e0af-4f63-9458-6f0f53b44f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:22 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99155d5c-e0af-4f63-9458-6f0f53b44f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:22 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae54993a-9b97-4253-96a0-a06893f38828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:22 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Volume c139d87d-a256-4cc1-a571-783184eed481: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c139d87d-a256-4cc1-a571-783184eed481', 'volume_size': 1, 'snapshot_id': '08bd3405-0a5f-49c6-8c45-21d1ff5522bd'} Jun 24 10:09:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:23 devstack sudo[114432]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-460a4ff4-0a45-44af-b4cb-a91b3b287cd1 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.31783c1c-55e4-4d2b-bcec-f24ef0808407 1G" returned: 0 in 0.867s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-460a4ff4-0a45-44af-b4cb-a91b3b287cd1 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7811a67d-2813-424d-a617-3a0451072ff0 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.31783c1c-55e4-4d2b-bcec-f24ef0808407 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:23 devstack sudo[114438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7811a67d-2813-424d-a617-3a0451072ff0 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.31783c1c-55e4-4d2b-bcec-f24ef0808407 Jun 24 10:09:23 devstack sudo[114438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:23 devstack sudo[114438]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-460a4ff4-0a45-44af-b4cb-a91b3b287cd1 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7811a67d-2813-424d-a617-3a0451072ff0 -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.31783c1c-55e4-4d2b-bcec-f24ef0808407" returned: 0 in 0.706s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:23 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-460a4ff4-0a45-44af-b4cb-a91b3b287cd1 tempest-CreateVolumesFromSnapshotTest-883770034 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.31783c1c-55e4-4d2b-bcec-f24ef0808407 is being set with open permissions: ugo+rw Jun 24 10:09:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-460a4ff4-0a45-44af-b4cb-a91b3b287cd1 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.31783c1c-55e4-4d2b-bcec-f24ef0808407 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:23 devstack sudo[114443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.31783c1c-55e4-4d2b-bcec-f24ef0808407 Jun 24 10:09:23 devstack sudo[114443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:24 devstack sudo[114443]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-460a4ff4-0a45-44af-b4cb-a91b3b287cd1 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.31783c1c-55e4-4d2b-bcec-f24ef0808407" returned: 0 in 0.675s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-460a4ff4-0a45-44af-b4cb-a91b3b287cd1 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:24 devstack sudo[114446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.info Jun 24 10:09:24 devstack sudo[114446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 10:09:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:25 devstack sudo[114448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:09:25 devstack sudo[114448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:25 devstack sudo[114446]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-460a4ff4-0a45-44af-b4cb-a91b3b287cd1 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.info" returned: 0 in 0.662s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:25 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-460a4ff4-0a45-44af-b4cb-a91b3b287cd1 tempest-CreateVolumesFromSnapshotTest-883770034 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.info is being set with open permissions: ugo+rw Jun 24 10:09:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-460a4ff4-0a45-44af-b4cb-a91b3b287cd1 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:25 devstack sudo[114451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.info Jun 24 10:09:25 devstack sudo[114451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:25 devstack sudo[114448]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.709s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:09:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 10:09:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 28 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 10:09:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 10:09:25 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:09:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Flow 'volume_create_manager' (85a5ec87-f559-4139-a8f4-86b45ea8cb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:09:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45d55188-cc9f-4b62-a49d-ef7880433f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45d55188-cc9f-4b62-a49d-ef7880433f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e8dfc3-dd85-4733-9b4b-90fff1cfee52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d58cfc7baeb547769835756d1bd79370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:09:26Z,use_quota=True,user_id='32508cfe131e4a52a590bcfcc00a372c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b5a9d7-d9a7-497a-b31d-d88d2b9360a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75b5a9d7-d9a7-497a-b31d-d88d2b9360a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0576509-7197-45e4-b84e-69bbf5517867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:25 devstack cinder-volume[93447]: DEBUG cinder.image.glance [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Creating Keystone auth plugin from conf {{(pid=93447) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 24 10:09:26 devstack sudo[114451]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-460a4ff4-0a45-44af-b4cb-a91b3b287cd1 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.info" returned: 0 in 0.694s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-460a4ff4-0a45-44af-b4cb-a91b3b287cd1 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.697s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.420s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a549dab1-ac64-46ad-91f9-15724615756c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b9282d86c8b40c89e832e543d5f262c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:09:20Z,use_quota=True,user_id='4f0ace47d3394fee882d0fd3eb8ee433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:09:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Creating volume a549dab1-ac64-46ad-91f9-15724615756c {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:09:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:26 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:09:26 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:09:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a549dab1-ac64-46ad-91f9-15724615756c 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:26 devstack sudo[114455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a549dab1-ac64-46ad-91f9-15724615756c 1073741824 Jun 24 10:09:26 devstack sudo[114455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:26 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-460a4ff4-0a45-44af-b4cb-a91b3b287cd1 tempest-CreateVolumesFromSnapshotTest-883770034 None] Create snapshot completed successfully Jun 24 10:09:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0576509-7197-45e4-b84e-69bbf5517867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '79e8dfc3-dd85-4733-9b4b-90fff1cfee52', 'volume_name': 'volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52', 'volume_size': 1, 'image_id': '39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1d71347af92a86d4f277eb5aceb5b186', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd58cfc7baeb547769835756d1bd79370', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fb727e5a4d977bb32790d776b24d26af7480a2e1a75bd2cedef29e2705e0693bfa037a99a2baeb233b768ae981a2b43e40947a1ad283f841f4a9e4c9268f242a', 'id': '39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc', 'created_at': datetime.datetime(2026, 6, 24, 8, 9, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 8, 9, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc/file', 'properties': {}}, 'image_service': }' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83dd4402-8c97-447a-9f46-ae08cdf7deac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83dd4402-8c97-447a-9f46-ae08cdf7deac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:26 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c5ce340-d3af-408f-a271-e6f29c11c11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:26 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Volume 79e8dfc3-dd85-4733-9b4b-90fff1cfee52: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52', 'volume_size': 1, 'image_id': '39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1d71347af92a86d4f277eb5aceb5b186', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd58cfc7baeb547769835756d1bd79370', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fb727e5a4d977bb32790d776b24d26af7480a2e1a75bd2cedef29e2705e0693bfa037a99a2baeb233b768ae981a2b43e40947a1ad283f841f4a9e4c9268f242a', 'id': '39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc', 'created_at': datetime.datetime(2026, 6, 24, 8, 9, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 8, 9, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc/file', 'properties': {}}, 'image_service': } Jun 24 10:09:26 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Trying to clone 79e8dfc3-dd85-4733-9b4b-90fff1cfee52 from image 39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc at location (None, [{'url': 'file:///opt/stack/data/glance/images/39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc', 'metadata': {}}]). {{(pid=93447) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 24 10:09:26 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 24 10:09:26 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Image download 0.00 MB at 0.00 MB/s Jun 24 10:09:26 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3267711e-65e8-41fe-8cce-8feb5c236361]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:26 devstack sudo[114457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD Jun 24 10:09:26 devstack sudo[114457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:26 devstack sudo[114455]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a549dab1-ac64-46ad-91f9-15724615756c 1073741824" returned: 0 in 0.905s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a549dab1-ac64-46ad-91f9-15724615756c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:27 devstack sudo[114463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a549dab1-ac64-46ad-91f9-15724615756c Jun 24 10:09:27 devstack sudo[114463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Flow 'volume_create_manager' (30a0468c-9e59-4d93-81f5-7e870f87e62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b3f8877-b185-4025-b249-50c8a2b9a2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b3f8877-b185-4025-b249-50c8a2b9a2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1166861904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c536ef-26ce-425c-b3d6-25edad7bbcfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5543b685553448c3b4c1dcadeda1c861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:09:27Z,use_quota=True,user_id='8565dd4e36334446bf50a503828b5b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef9af38-f34f-4aca-9159-3955a6c238d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef9af38-f34f-4aca-9159-3955a6c238d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd3b1fb-7514-41c7-aa29-f8945b0ab247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd3b1fb-7514-41c7-aa29-f8945b0ab247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6c536ef-26ce-425c-b3d6-25edad7bbcfa', 'volume_name': 'volume-b6c536ef-26ce-425c-b3d6-25edad7bbcfa', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c43121-62e7-4318-a865-7c63c5837da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c43121-62e7-4318-a865-7c63c5837da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa822f3f-299d-4708-980d-759b0e5e0adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:27 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Volume b6c536ef-26ce-425c-b3d6-25edad7bbcfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6c536ef-26ce-425c-b3d6-25edad7bbcfa', 'volume_size': 1} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:27 devstack sudo[114457]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD" returned: 0 in 0.919s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:27 devstack sudo[114467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD Jun 24 10:09:27 devstack sudo[114467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Flow 'volume_create_manager' (975b430f-75e5-4c14-83cb-6f85d04489f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffa64085-093a-408d-bb7c-c27cbafb7f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffa64085-093a-408d-bb7c-c27cbafb7f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2013732093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbadf09f-feea-439f-b109-de91db62baf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5543b685553448c3b4c1dcadeda1c861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:09:27Z,use_quota=True,user_id='8565dd4e36334446bf50a503828b5b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab44190-6f16-4254-a5e3-57850a003d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab44190-6f16-4254-a5e3-57850a003d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5713fa-e40c-428e-82af-5d90427b6fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5713fa-e40c-428e-82af-5d90427b6fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbadf09f-feea-439f-b109-de91db62baf7', 'volume_name': 'volume-bbadf09f-feea-439f-b109-de91db62baf7', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f2f464-57bd-4ffd-81a0-636f120cafce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f2f464-57bd-4ffd-81a0-636f120cafce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5942e7b-a602-4b5f-b44d-86799b461110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:27 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Volume bbadf09f-feea-439f-b109-de91db62baf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbadf09f-feea-439f-b109-de91db62baf7', 'volume_size': 1} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:27 devstack sudo[114463]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a549dab1-ac64-46ad-91f9-15724615756c" returned: 0 in 0.780s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.264s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Acquiring lock "cinder-quobyte-08bd3405-0a5f-49c6-8c45-21d1ff5522bd-c139d87d-a256-4cc1-a571-783184eed481" by "_create_volume_from_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d45292a-4770-4c81-80d3-dd594cd780cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a549dab1-ac64-46ad-91f9-15724615756c', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6d2135-1263-496b-b64d-f1d143f63e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Lock "cinder-quobyte-08bd3405-0a5f-49c6-8c45-21d1ff5522bd-c139d87d-a256-4cc1-a571-783184eed481" acquired by "_create_volume_from_snapshot" :: waited 0.054s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Creating volume c139d87d-a256-4cc1-a571-783184eed481 from snapshot 08bd3405-0a5f-49c6-8c45-21d1ff5522bd {{(pid=93447) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Acquiring lock "cinder-quobyte-c139d87d-a256-4cc1-a571-783184eed481" by "_copy_volume_from_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:27 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Volume volume-a549dab1-ac64-46ad-91f9-15724615756c (a549dab1-ac64-46ad-91f9-15724615756c): created successfully Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6d2135-1263-496b-b64d-f1d143f63e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Flow 'volume_create_manager' (ff6403f5-cabb-4d0d-b50c-666f2ba9d7df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Lock "cinder-quobyte-c139d87d-a256-4cc1-a571-783184eed481" acquired by "_copy_volume_from_snapshot" :: waited 0.055s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] snapshot: 08bd3405-0a5f-49c6-8c45-21d1ff5522bd, volume: c139d87d-a256-4cc1-a571-783184eed481, {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:27 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-69191077-c4ff-444d-9876-d4cd253c1026 tempest-CinderUnicodeTest-1649824085 None] Created volume successfully. Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Flow 'volume_create_manager' (e1e2aabd-fdee-48d6-b5b8-280a6c38636c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75222b48-a126-4909-83dd-1252a2d498be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afc4573-e2c5-40a3-addc-faef3bf77b7a]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.08bd3405-0a5f-49c6-8c45-21d1ff5522bd {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75222b48-a126-4909-83dd-1252a2d498be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-580725187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8957803-fc40-4adb-9c08-cbd619d0a10b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5543b685553448c3b4c1dcadeda1c861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:09:28Z,use_quota=True,user_id='8565dd4e36334446bf50a503828b5b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae7c4cf5-1d00-4c18-aed7-b43977dc3e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae7c4cf5-1d00-4c18-aed7-b43977dc3e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f758df66-2271-4a1f-ab0d-cc8c941bbb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f758df66-2271-4a1f-ab0d-cc8c941bbb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8957803-fc40-4adb-9c08-cbd619d0a10b', 'volume_name': 'volume-a8957803-fc40-4adb-9c08-cbd619d0a10b', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b04306-9652-49cc-95e3-a568d156c3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b04306-9652-49cc-95e3-a568d156c3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c72608-4fdb-4848-9e11-5a452a73d0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:28 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Volume a8957803-fc40-4adb-9c08-cbd619d0a10b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8957803-fc40-4adb-9c08-cbd619d0a10b', 'volume_size': 1} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:28 devstack sudo[114467]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD" returned: 1 in 0.871s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Temporary image 39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc is fetched for user 32508cfe131e4a52a590bcfcc00a372c. {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 24 10:09:28 devstack sudo[114470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.08bd3405-0a5f-49c6-8c45-21d1ff5522bd Jun 24 10:09:28 devstack sudo[114470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47d7040-a6cf-4729-93de-599693ebe696]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Flow 'volume_create_manager' (8bed853d-d09e-41a2-b395-fc020faeb93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf651077-158a-4cba-99bc-25ab08f19506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf651077-158a-4cba-99bc-25ab08f19506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-341799633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf858ec3-10ad-4933-aadd-93ad9e83f836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5543b685553448c3b4c1dcadeda1c861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:09:28Z,use_quota=True,user_id='8565dd4e36334446bf50a503828b5b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4aa320-9bc7-4fa2-9a3b-96415744933c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4aa320-9bc7-4fa2-9a3b-96415744933c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e1bf99-36f8-4ebb-ae7f-b93fcc968713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e1bf99-36f8-4ebb-ae7f-b93fcc968713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf858ec3-10ad-4933-aadd-93ad9e83f836', 'volume_name': 'volume-cf858ec3-10ad-4933-aadd-93ad9e83f836', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:28 devstack sudo[114475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD Jun 24 10:09:28 devstack sudo[114475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94aa2fbe-5086-4122-80cd-2baf5e8ee4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94aa2fbe-5086-4122-80cd-2baf5e8ee4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc6e2f9-3805-4638-91ab-a9050c80241d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:28 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Volume cf858ec3-10ad-4933-aadd-93ad9e83f836: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf858ec3-10ad-4933-aadd-93ad9e83f836', 'volume_size': 1} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Flow 'volume_create_manager' (4fd8dfb1-01d2-4ee6-aef4-c3d93166180d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2e124d9-9eb4-457a-868d-c22e6b52896c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2e124d9-9eb4-457a-868d-c22e6b52896c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1553453678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ec6d29-4999-4e85-8fb1-17124cbd5619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5543b685553448c3b4c1dcadeda1c861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:09:29Z,use_quota=True,user_id='8565dd4e36334446bf50a503828b5b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (492fbcb1-bf8e-46bb-9087-892aeb8aa379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (492fbcb1-bf8e-46bb-9087-892aeb8aa379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff8b3000-9e6c-4a7b-94b9-8ff8c3b67c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff8b3000-9e6c-4a7b-94b9-8ff8c3b67c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47ec6d29-4999-4e85-8fb1-17124cbd5619', 'volume_name': 'volume-47ec6d29-4999-4e85-8fb1-17124cbd5619', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabe9e64-c463-45b0-bf09-e53db8180afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabe9e64-c463-45b0-bf09-e53db8180afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46bd645a-f1a1-4077-9a11-da7c18481c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:28 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Volume 47ec6d29-4999-4e85-8fb1-17124cbd5619: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47ec6d29-4999-4e85-8fb1-17124cbd5619', 'volume_size': 1} Jun 24 10:09:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.08bd3405-0a5f-49c6-8c45-21d1ff5522bd" returned: 0 in 0.990s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:29 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:09:29 devstack sudo[114470]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:29 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 24 10:09:29 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Creating direct copy from snapshot {{(pid=93447) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 24 10:09:29 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d4450e-9929-476e-8240-0c68a01092fc]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:29 devstack sudo[114516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 Jun 24 10:09:29 devstack sudo[114516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:29 devstack sudo[114475]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD" returned: 0 in 0.936s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:29 devstack sudo[114521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD Jun 24 10:09:29 devstack sudo[114521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:29 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:09:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Flow 'volume_create_manager' (6c1d1ccd-73d1-41b9-b996-e812305c47a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:09:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (537157e8-4a73-4b21-93fd-f7b75d632c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (537157e8-4a73-4b21-93fd-f7b75d632c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:09:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1484780710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1af9668-3ae0-49a8-8527-2ecca22c7c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b9282d86c8b40c89e832e543d5f262c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:09:30Z,use_quota=True,user_id='4f0ace47d3394fee882d0fd3eb8ee433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3752bbc2-b733-44bd-9878-bba2b38ef9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3752bbc2-b733-44bd-9878-bba2b38ef9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66902194-a383-4152-ad0f-59506aaa85fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66902194-a383-4152-ad0f-59506aaa85fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1af9668-3ae0-49a8-8527-2ecca22c7c4f', 'volume_name': 'volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1081cd84-2912-4046-8586-846f46b1b47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1081cd84-2912-4046-8586-846f46b1b47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:29 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f384490-35bc-44a5-8aee-3308b453f2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:29 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Volume a1af9668-3ae0-49a8-8527-2ecca22c7c4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f', 'volume_size': 1} Jun 24 10:09:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:29 devstack sudo[114516]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485" returned: 0 in 0.824s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:29 devstack cinder-volume[93447]: DEBUG cinder.utils [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Path /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-c139d87d-a256-4cc1-a571-783184eed481 not found in is_blk_device check {{(pid=93447) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 24 10:09:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-c139d87d-a256-4cc1-a571-783184eed481 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:29 devstack sudo[114526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-c139d87d-a256-4cc1-a571-783184eed481 Jun 24 10:09:29 devstack sudo[114526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:30 devstack sudo[114521]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD" returned: 1 in 0.812s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:09:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:34 devstack sudo[114526]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-c139d87d-a256-4cc1-a571-783184eed481" returned: 0 in 4.678s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:34 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5164cce-0a05-4e52-8c8d-4ea9c114d15e]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:34 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:34 devstack sudo[114543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 Jun 24 10:09:34 devstack sudo[114543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:35 devstack sudo[114543]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485" returned: 0 in 0.892s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:35 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Image conversion details: src /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485, size 1024.00 MB, duration 4.68 sec, destination /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-c139d87d-a256-4cc1-a571-783184eed481 {{(pid=93447) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 10:09:35 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Converted 1024.00 MB image at 218.84 MB/s Jun 24 10:09:35 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-c139d87d-a256-4cc1-a571-783184eed481 is being set with open permissions: ugo+rw Jun 24 10:09:35 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-c139d87d-a256-4cc1-a571-783184eed481 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:35 devstack sudo[114548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-c139d87d-a256-4cc1-a571-783184eed481 Jun 24 10:09:35 devstack sudo[114548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:36 devstack sudo[114548]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-c139d87d-a256-4cc1-a571-783184eed481" returned: 0 in 0.627s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Lock "cinder-quobyte-c139d87d-a256-4cc1-a571-783184eed481" released by "_copy_volume_from_snapshot" :: held 8.185s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Lock "cinder-quobyte-08bd3405-0a5f-49c6-8c45-21d1ff5522bd-c139d87d-a256-4cc1-a571-783184eed481" released by "_create_volume_from_snapshot" :: held 8.280s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.335s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.929s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1166861904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c536ef-26ce-425c-b3d6-25edad7bbcfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5543b685553448c3b4c1dcadeda1c861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:09:27Z,use_quota=True,user_id='8565dd4e36334446bf50a503828b5b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Creating volume b6c536ef-26ce-425c-b3d6-25edad7bbcfa {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:09:36 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b6c536ef-26ce-425c-b3d6-25edad7bbcfa 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:36 devstack sudo[114551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b6c536ef-26ce-425c-b3d6-25edad7bbcfa 1073741824 Jun 24 10:09:36 devstack sudo[114551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae54993a-9b97-4253-96a0-a06893f38828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c139d87d-a256-4cc1-a571-783184eed481', 'volume_size': 1, 'snapshot_id': '08bd3405-0a5f-49c6-8c45-21d1ff5522bd'}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (321709c6-b62d-476d-8b6f-4de32ec90379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:36 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Volume volume-c139d87d-a256-4cc1-a571-783184eed481 (c139d87d-a256-4cc1-a571-783184eed481): created successfully Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (321709c6-b62d-476d-8b6f-4de32ec90379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Flow 'volume_create_manager' (656d7341-9e64-47a8-a51e-c225c359720e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:09:36 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-2d56ac17-9de7-4189-94fb-567d17820288 tempest-SnapshotDependencyTests-129623090 None] Created volume successfully. Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-66257b9c-9a38-45ad-bbe8-0d3044354cd1 tempest-SnapshotDependencyTests-129623090 None] Acquiring lock "cinder-08bd3405-0a5f-49c6-8c45-21d1ff5522bd-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-66257b9c-9a38-45ad-bbe8-0d3044354cd1 tempest-SnapshotDependencyTests-129623090 None] Lock "cinder-08bd3405-0a5f-49c6-8c45-21d1ff5522bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-66257b9c-9a38-45ad-bbe8-0d3044354cd1 tempest-SnapshotDependencyTests-129623090 None] Acquiring lock "cinder-quobyte-ddfd5f50-88de-4268-b8e1-f9578cc9c485" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-66257b9c-9a38-45ad-bbe8-0d3044354cd1 tempest-SnapshotDependencyTests-129623090 None] Lock "cinder-quobyte-ddfd5f50-88de-4268-b8e1-f9578cc9c485" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-66257b9c-9a38-45ad-bbe8-0d3044354cd1 tempest-SnapshotDependencyTests-129623090 None] Acquiring lock "cinder-quobyte-08bd3405-0a5f-49c6-8c45-21d1ff5522bd" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-66257b9c-9a38-45ad-bbe8-0d3044354cd1 tempest-SnapshotDependencyTests-129623090 None] Lock "cinder-quobyte-08bd3405-0a5f-49c6-8c45-21d1ff5522bd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-66257b9c-9a38-45ad-bbe8-0d3044354cd1 tempest-SnapshotDependencyTests-129623090 None] Deleting offline snapshot 08bd3405-0a5f-49c6-8c45-21d1ff5522bd of volume ddfd5f50-88de-4268-b8e1-f9578cc9c485 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-66257b9c-9a38-45ad-bbe8-0d3044354cd1 tempest-SnapshotDependencyTests-129623090 None] snapshot_file for this snap is: volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.08bd3405-0a5f-49c6-8c45-21d1ff5522bd {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbf6008-efc3-4db4-9a5d-1bcaabadbc25]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-66257b9c-9a38-45ad-bbe8-0d3044354cd1 tempest-SnapshotDependencyTests-129623090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.08bd3405-0a5f-49c6-8c45-21d1ff5522bd {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:36 devstack sudo[114553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.08bd3405-0a5f-49c6-8c45-21d1ff5522bd Jun 24 10:09:36 devstack sudo[114553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:36 devstack sudo[114551]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b6c536ef-26ce-425c-b3d6-25edad7bbcfa 1073741824" returned: 0 in 0.813s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:36 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b6c536ef-26ce-425c-b3d6-25edad7bbcfa {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:36 devstack sudo[114559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b6c536ef-26ce-425c-b3d6-25edad7bbcfa Jun 24 10:09:37 devstack sudo[114559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:37 devstack sudo[114553]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-66257b9c-9a38-45ad-bbe8-0d3044354cd1 tempest-SnapshotDependencyTests-129623090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.08bd3405-0a5f-49c6-8c45-21d1ff5522bd" returned: 0 in 0.752s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:37 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-66257b9c-9a38-45ad-bbe8-0d3044354cd1 tempest-SnapshotDependencyTests-129623090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:09:37 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c111fa44-e891-402f-abcf-4f568c66ecc3]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-66257b9c-9a38-45ad-bbe8-0d3044354cd1 tempest-SnapshotDependencyTests-129623090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:37 devstack sudo[114564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 Jun 24 10:09:37 devstack sudo[114564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:37 devstack sudo[114559]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b6c536ef-26ce-425c-b3d6-25edad7bbcfa" returned: 0 in 0.631s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:37 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:09:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.049s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:37 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2013732093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbadf09f-feea-439f-b109-de91db62baf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5543b685553448c3b4c1dcadeda1c861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:09:27Z,use_quota=True,user_id='8565dd4e36334446bf50a503828b5b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:09:37 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Creating volume bbadf09f-feea-439f-b109-de91db62baf7 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:09:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:37 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:37 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:37 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:09:37 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:09:37 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-bbadf09f-feea-439f-b109-de91db62baf7 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:37 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:UPDATE=113,cinder:SELECT=93,cinder:INSERT=24,cinder:DELETE=11 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 10:09:37 devstack sudo[114567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-bbadf09f-feea-439f-b109-de91db62baf7 1073741824 Jun 24 10:09:37 devstack sudo[114567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:37 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa822f3f-299d-4708-980d-759b0e5e0adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6c536ef-26ce-425c-b3d6-25edad7bbcfa', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:37 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66a5dcb8-49bb-40f2-bf9f-4c26537f1623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:37 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Volume volume-b6c536ef-26ce-425c-b3d6-25edad7bbcfa (b6c536ef-26ce-425c-b3d6-25edad7bbcfa): created successfully Jun 24 10:09:37 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66a5dcb8-49bb-40f2-bf9f-4c26537f1623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:37 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Flow 'volume_create_manager' (30a0468c-9e59-4d93-81f5-7e870f87e62e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:09:37 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-d632b6c9-5638-4fc6-b8b9-e8cfbb34431f tempest-CreateVolumesFromSnapshotTest-883770034 None] Created volume successfully. Jun 24 10:09:38 devstack sudo[114564]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-66257b9c-9a38-45ad-bbe8-0d3044354cd1 tempest-SnapshotDependencyTests-129623090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485" returned: 0 in 0.764s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-66257b9c-9a38-45ad-bbe8-0d3044354cd1 tempest-SnapshotDependencyTests-129623090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.08bd3405-0a5f-49c6-8c45-21d1ff5522bd {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:38 devstack sudo[114574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.08bd3405-0a5f-49c6-8c45-21d1ff5522bd Jun 24 10:09:38 devstack sudo[114574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:38 devstack sudo[114567]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-bbadf09f-feea-439f-b109-de91db62baf7 1073741824" returned: 0 in 0.885s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:38 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:SELECT=101,cinder:UPDATE=119,cinder:INSERT=37,cinder:DELETE=12 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 10:09:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-bbadf09f-feea-439f-b109-de91db62baf7 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:38 devstack sudo[114578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-bbadf09f-feea-439f-b109-de91db62baf7 Jun 24 10:09:38 devstack sudo[114578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:38 devstack sudo[114574]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-66257b9c-9a38-45ad-bbe8-0d3044354cd1 tempest-SnapshotDependencyTests-129623090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.08bd3405-0a5f-49c6-8c45-21d1ff5522bd" returned: 0 in 0.784s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:38 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-66257b9c-9a38-45ad-bbe8-0d3044354cd1 tempest-SnapshotDependencyTests-129623090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.08bd3405-0a5f-49c6-8c45-21d1ff5522bd {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:38 devstack sudo[114583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.08bd3405-0a5f-49c6-8c45-21d1ff5522bd Jun 24 10:09:38 devstack sudo[114583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:39 devstack sudo[114578]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-bbadf09f-feea-439f-b109-de91db62baf7" returned: 0 in 0.650s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:09:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.086s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-580725187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8957803-fc40-4adb-9c08-cbd619d0a10b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5543b685553448c3b4c1dcadeda1c861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:09:28Z,use_quota=True,user_id='8565dd4e36334446bf50a503828b5b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:09:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Creating volume a8957803-fc40-4adb-9c08-cbd619d0a10b {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:09:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:39 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:09:39 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:09:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a8957803-fc40-4adb-9c08-cbd619d0a10b 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5942e7b-a602-4b5f-b44d-86799b461110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbadf09f-feea-439f-b109-de91db62baf7', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:39 devstack sudo[114586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a8957803-fc40-4adb-9c08-cbd619d0a10b 1073741824 Jun 24 10:09:39 devstack sudo[114586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c1853c3-526d-4040-ba1e-795902987629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:39 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Volume volume-bbadf09f-feea-439f-b109-de91db62baf7 (bbadf09f-feea-439f-b109-de91db62baf7): created successfully Jun 24 10:09:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c1853c3-526d-4040-ba1e-795902987629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:39 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Flow 'volume_create_manager' (975b430f-75e5-4c14-83cb-6f85d04489f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:09:39 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-cd9c93da-cc61-48cf-ac78-6ec9af2894f4 tempest-CreateVolumesFromSnapshotTest-883770034 None] Created volume successfully. Jun 24 10:09:39 devstack sudo[114583]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:39 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-66257b9c-9a38-45ad-bbe8-0d3044354cd1 tempest-SnapshotDependencyTests-129623090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485.08bd3405-0a5f-49c6-8c45-21d1ff5522bd" returned: 0 in 0.655s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-66257b9c-9a38-45ad-bbe8-0d3044354cd1 tempest-SnapshotDependencyTests-129623090 None] Lock "cinder-quobyte-08bd3405-0a5f-49c6-8c45-21d1ff5522bd" released by "_delete_snapshot" :: held 3.064s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-66257b9c-9a38-45ad-bbe8-0d3044354cd1 tempest-SnapshotDependencyTests-129623090 None] Lock "cinder-quobyte-ddfd5f50-88de-4268-b8e1-f9578cc9c485" released by "delete_snapshot" :: held 3.088s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:39 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-66257b9c-9a38-45ad-bbe8-0d3044354cd1 tempest-SnapshotDependencyTests-129623090 None] Created reservations ['aa077992-f55d-4ff5-801f-3acc0b6500de', '7495dbef-5a0b-4ff6-8866-d6ce05d53f43', '22ab1d4d-5905-4077-bd66-8d2c5d3e66c1', 'af5b2e50-e988-42ad-b228-ba3dc8ec5e98'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:09:39 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-66257b9c-9a38-45ad-bbe8-0d3044354cd1 tempest-SnapshotDependencyTests-129623090 None] Delete snapshot completed successfully. Jun 24 10:09:39 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-66257b9c-9a38-45ad-bbe8-0d3044354cd1 tempest-SnapshotDependencyTests-129623090 None] Lock "cinder-08bd3405-0a5f-49c6-8c45-21d1ff5522bd-delete_snapshot" released by "delete_snapshot" :: held 3.226s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:40 devstack sudo[114586]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a8957803-fc40-4adb-9c08-cbd619d0a10b 1073741824" returned: 0 in 0.820s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a8957803-fc40-4adb-9c08-cbd619d0a10b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:40 devstack sudo[114592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a8957803-fc40-4adb-9c08-cbd619d0a10b Jun 24 10:09:40 devstack sudo[114592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:40 devstack sudo[114592]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a8957803-fc40-4adb-9c08-cbd619d0a10b" returned: 0 in 0.617s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.240s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-341799633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf858ec3-10ad-4933-aadd-93ad9e83f836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5543b685553448c3b4c1dcadeda1c861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:09:28Z,use_quota=True,user_id='8565dd4e36334446bf50a503828b5b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Creating volume cf858ec3-10ad-4933-aadd-93ad9e83f836 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:09:40 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf858ec3-10ad-4933-aadd-93ad9e83f836 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:40 devstack sudo[114595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf858ec3-10ad-4933-aadd-93ad9e83f836 1073741824 Jun 24 10:09:40 devstack sudo[114595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c72608-4fdb-4848-9e11-5a452a73d0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8957803-fc40-4adb-9c08-cbd619d0a10b', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56968138-89dd-482c-88b9-3bcff11c5573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:40 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Volume volume-a8957803-fc40-4adb-9c08-cbd619d0a10b (a8957803-fc40-4adb-9c08-cbd619d0a10b): created successfully Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56968138-89dd-482c-88b9-3bcff11c5573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Flow 'volume_create_manager' (e1e2aabd-fdee-48d6-b5b8-280a6c38636c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d2f3f98c-7619-4a52-9b8c-97c154bd017a tempest-SnapshotDependencyTests-129623090 None] Acquiring lock "cinder-ddfd5f50-88de-4268-b8e1-f9578cc9c485-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:40 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-2654051d-7cd2-48a7-af7a-ddd0a7b38237 tempest-CreateVolumesFromSnapshotTest-883770034 None] Created volume successfully. Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d2f3f98c-7619-4a52-9b8c-97c154bd017a tempest-SnapshotDependencyTests-129623090 None] Lock "cinder-ddfd5f50-88de-4268-b8e1-f9578cc9c485-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d2f3f98c-7619-4a52-9b8c-97c154bd017a tempest-SnapshotDependencyTests-129623090 None] Acquiring lock "cinder-quobyte-ddfd5f50-88de-4268-b8e1-f9578cc9c485" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d2f3f98c-7619-4a52-9b8c-97c154bd017a tempest-SnapshotDependencyTests-129623090 None] Lock "cinder-quobyte-ddfd5f50-88de-4268-b8e1-f9578cc9c485" acquired by "delete_volume" :: waited 0.025s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cb3d1d-6397-4872-bfd1-905f96cb3bd1]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:40 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d2f3f98c-7619-4a52-9b8c-97c154bd017a tempest-SnapshotDependencyTests-129623090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:41 devstack sudo[114597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 Jun 24 10:09:41 devstack sudo[114597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:41 devstack sudo[114595]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf858ec3-10ad-4933-aadd-93ad9e83f836 1073741824" returned: 0 in 0.830s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf858ec3-10ad-4933-aadd-93ad9e83f836 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:41 devstack sudo[114606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf858ec3-10ad-4933-aadd-93ad9e83f836 Jun 24 10:09:41 devstack sudo[114606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:41 devstack sudo[114597]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d2f3f98c-7619-4a52-9b8c-97c154bd017a tempest-SnapshotDependencyTests-129623090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485" returned: 0 in 0.778s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:41 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d2f3f98c-7619-4a52-9b8c-97c154bd017a tempest-SnapshotDependencyTests-129623090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:41 devstack sudo[114608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485 Jun 24 10:09:41 devstack sudo[114608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:42 devstack sudo[114606]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf858ec3-10ad-4933-aadd-93ad9e83f836" returned: 0 in 0.672s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.342s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1553453678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ec6d29-4999-4e85-8fb1-17124cbd5619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5543b685553448c3b4c1dcadeda1c861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:09:29Z,use_quota=True,user_id='8565dd4e36334446bf50a503828b5b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Creating volume 47ec6d29-4999-4e85-8fb1-17124cbd5619 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:09:42 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47ec6d29-4999-4e85-8fb1-17124cbd5619 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc6e2f9-3805-4638-91ab-a9050c80241d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf858ec3-10ad-4933-aadd-93ad9e83f836', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:42 devstack sudo[114613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47ec6d29-4999-4e85-8fb1-17124cbd5619 1073741824 Jun 24 10:09:42 devstack sudo[114613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46139422-bb59-4db4-af2d-8c9d5de96a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:42 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Volume volume-cf858ec3-10ad-4933-aadd-93ad9e83f836 (cf858ec3-10ad-4933-aadd-93ad9e83f836): created successfully Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46139422-bb59-4db4-af2d-8c9d5de96a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Flow 'volume_create_manager' (8bed853d-d09e-41a2-b395-fc020faeb93e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:09:42 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-c38362f3-22cb-4e70-ae7c-9c82538c607a tempest-CreateVolumesFromSnapshotTest-883770034 None] Created volume successfully. Jun 24 10:09:42 devstack sudo[114608]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d2f3f98c-7619-4a52-9b8c-97c154bd017a tempest-SnapshotDependencyTests-129623090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-ddfd5f50-88de-4268-b8e1-f9578cc9c485" returned: 0 in 0.677s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d2f3f98c-7619-4a52-9b8c-97c154bd017a tempest-SnapshotDependencyTests-129623090 None] Lock "cinder-quobyte-ddfd5f50-88de-4268-b8e1-f9578cc9c485" released by "delete_volume" :: held 1.538s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-d2f3f98c-7619-4a52-9b8c-97c154bd017a tempest-SnapshotDependencyTests-129623090 None] Created reservations ['48e1c11c-8f84-408c-abfb-104d8002bd82', 'f612cf62-c52d-4210-babe-5db2e3444484', '4a4941c2-ccd2-4251-b87a-2b934a479c35', '3fe88177-797b-472e-804f-84f7129d75aa'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d2f3f98c-7619-4a52-9b8c-97c154bd017a tempest-SnapshotDependencyTests-129623090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d2f3f98c-7619-4a52-9b8c-97c154bd017a tempest-SnapshotDependencyTests-129623090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d2f3f98c-7619-4a52-9b8c-97c154bd017a tempest-SnapshotDependencyTests-129623090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-d2f3f98c-7619-4a52-9b8c-97c154bd017a tempest-SnapshotDependencyTests-129623090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-d2f3f98c-7619-4a52-9b8c-97c154bd017a tempest-SnapshotDependencyTests-129623090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:42 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d2f3f98c-7619-4a52-9b8c-97c154bd017a tempest-SnapshotDependencyTests-129623090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:42 devstack sudo[114615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:09:42 devstack sudo[114615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9aad88f4-50b6-430a-bee5-29c5b7e4b9a7 tempest-SnapshotDependencyTests-129623090 None] Acquiring lock "cinder-c139d87d-a256-4cc1-a571-783184eed481-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9aad88f4-50b6-430a-bee5-29c5b7e4b9a7 tempest-SnapshotDependencyTests-129623090 None] Lock "cinder-c139d87d-a256-4cc1-a571-783184eed481-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9aad88f4-50b6-430a-bee5-29c5b7e4b9a7 tempest-SnapshotDependencyTests-129623090 None] Acquiring lock "cinder-quobyte-c139d87d-a256-4cc1-a571-783184eed481" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9aad88f4-50b6-430a-bee5-29c5b7e4b9a7 tempest-SnapshotDependencyTests-129623090 None] Lock "cinder-quobyte-c139d87d-a256-4cc1-a571-783184eed481" acquired by "delete_volume" :: waited 0.026s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[de94032b-4bbc-4815-89b0-b209541b7839]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9aad88f4-50b6-430a-bee5-29c5b7e4b9a7 tempest-SnapshotDependencyTests-129623090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-c139d87d-a256-4cc1-a571-783184eed481 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:43 devstack sudo[114613]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47ec6d29-4999-4e85-8fb1-17124cbd5619 1073741824" returned: 0 in 0.953s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47ec6d29-4999-4e85-8fb1-17124cbd5619 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:43 devstack sudo[114615]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-d2f3f98c-7619-4a52-9b8c-97c154bd017a tempest-SnapshotDependencyTests-129623090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.754s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:43 devstack sudo[114623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47ec6d29-4999-4e85-8fb1-17124cbd5619 Jun 24 10:09:43 devstack sudo[114623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-d2f3f98c-7619-4a52-9b8c-97c154bd017a tempest-SnapshotDependencyTests-129623090 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:09:43 devstack sudo[114622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-c139d87d-a256-4cc1-a571-783184eed481 Jun 24 10:09:43 devstack sudo[114622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:43 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-d2f3f98c-7619-4a52-9b8c-97c154bd017a tempest-SnapshotDependencyTests-129623090 None] Deleted volume successfully. Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-d2f3f98c-7619-4a52-9b8c-97c154bd017a tempest-SnapshotDependencyTests-129623090 None] Lock "cinder-ddfd5f50-88de-4268-b8e1-f9578cc9c485-delete_volume" released by "delete_volume" :: held 2.521s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:43 devstack sudo[114623]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47ec6d29-4999-4e85-8fb1-17124cbd5619" returned: 0 in 0.687s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.282s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:09:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1484780710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1af9668-3ae0-49a8-8527-2ecca22c7c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b9282d86c8b40c89e832e543d5f262c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:09:30Z,use_quota=True,user_id='4f0ace47d3394fee882d0fd3eb8ee433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Creating volume a1af9668-3ae0-49a8-8527-2ecca22c7c4f {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:09:43 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:43 devstack sudo[114622]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9aad88f4-50b6-430a-bee5-29c5b7e4b9a7 tempest-SnapshotDependencyTests-129623090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-c139d87d-a256-4cc1-a571-783184eed481" returned: 0 in 0.830s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:43 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9aad88f4-50b6-430a-bee5-29c5b7e4b9a7 tempest-SnapshotDependencyTests-129623090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-c139d87d-a256-4cc1-a571-783184eed481 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:44 devstack sudo[114630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f 1073741824 Jun 24 10:09:44 devstack sudo[114630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46bd645a-f1a1-4077-9a11-da7c18481c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47ec6d29-4999-4e85-8fb1-17124cbd5619', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e977be4b-0f67-41ad-a5d8-10aa629d9704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:44 devstack sudo[114631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-c139d87d-a256-4cc1-a571-783184eed481 Jun 24 10:09:44 devstack sudo[114631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:44 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Volume volume-47ec6d29-4999-4e85-8fb1-17124cbd5619 (47ec6d29-4999-4e85-8fb1-17124cbd5619): created successfully Jun 24 10:09:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e977be4b-0f67-41ad-a5d8-10aa629d9704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:44 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Flow 'volume_create_manager' (4fd8dfb1-01d2-4ee6-aef4-c3d93166180d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:09:44 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-7168fa1d-2742-4aa7-908f-8b1eb90d1468 tempest-CreateVolumesFromSnapshotTest-883770034 None] Created volume successfully. Jun 24 10:09:44 devstack sudo[114631]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9aad88f4-50b6-430a-bee5-29c5b7e4b9a7 tempest-SnapshotDependencyTests-129623090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-c139d87d-a256-4cc1-a571-783184eed481" returned: 0 in 0.742s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:44 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9aad88f4-50b6-430a-bee5-29c5b7e4b9a7 tempest-SnapshotDependencyTests-129623090 None] Lock "cinder-quobyte-c139d87d-a256-4cc1-a571-783184eed481" released by "delete_volume" :: held 1.619s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:44 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-9aad88f4-50b6-430a-bee5-29c5b7e4b9a7 tempest-SnapshotDependencyTests-129623090 None] Created reservations ['9d91fd51-55a9-4be3-9d63-4605ddec60ab', 'd2968602-24f2-4e99-9b5f-77c84171011c', '0f74a05b-07ad-4ccc-bdaa-41a91354979b', 'fb85b51c-058c-43d0-9d54-054efa406da9'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:09:44 devstack sudo[114630]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f 1073741824" returned: 0 in 0.890s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9aad88f4-50b6-430a-bee5-29c5b7e4b9a7 tempest-SnapshotDependencyTests-129623090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9aad88f4-50b6-430a-bee5-29c5b7e4b9a7 tempest-SnapshotDependencyTests-129623090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9aad88f4-50b6-430a-bee5-29c5b7e4b9a7 tempest-SnapshotDependencyTests-129623090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:44 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9aad88f4-50b6-430a-bee5-29c5b7e4b9a7 tempest-SnapshotDependencyTests-129623090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9aad88f4-50b6-430a-bee5-29c5b7e4b9a7 tempest-SnapshotDependencyTests-129623090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9aad88f4-50b6-430a-bee5-29c5b7e4b9a7 tempest-SnapshotDependencyTests-129623090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:44 devstack sudo[114638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:09:44 devstack sudo[114638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:44 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:44 devstack sudo[114640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f Jun 24 10:09:44 devstack sudo[114640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-13073682-48de-4351-97e4-a2a1da9e611d tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "cinder-47ec6d29-4999-4e85-8fb1-17124cbd5619-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-13073682-48de-4351-97e4-a2a1da9e611d tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-47ec6d29-4999-4e85-8fb1-17124cbd5619-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-13073682-48de-4351-97e4-a2a1da9e611d tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "cinder-quobyte-47ec6d29-4999-4e85-8fb1-17124cbd5619" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-13073682-48de-4351-97e4-a2a1da9e611d tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-quobyte-47ec6d29-4999-4e85-8fb1-17124cbd5619" acquired by "delete_volume" :: waited 0.022s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[458c564d-c116-40f4-ae43-dca29da8d08d]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-13073682-48de-4351-97e4-a2a1da9e611d tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47ec6d29-4999-4e85-8fb1-17124cbd5619 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:45 devstack sudo[114642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47ec6d29-4999-4e85-8fb1-17124cbd5619 Jun 24 10:09:45 devstack sudo[114642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:45 devstack sudo[114638]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9aad88f4-50b6-430a-bee5-29c5b7e4b9a7 tempest-SnapshotDependencyTests-129623090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.807s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-9aad88f4-50b6-430a-bee5-29c5b7e4b9a7 tempest-SnapshotDependencyTests-129623090 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:09:45 devstack sudo[114640]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f" returned: 0 in 0.790s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:45 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-9aad88f4-50b6-430a-bee5-29c5b7e4b9a7 tempest-SnapshotDependencyTests-129623090 None] Deleted volume successfully. Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.678s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e8dfc3-dd85-4733-9b4b-90fff1cfee52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d58cfc7baeb547769835756d1bd79370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:09:26Z,use_quota=True,user_id='32508cfe131e4a52a590bcfcc00a372c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Creating volume 79e8dfc3-dd85-4733-9b4b-90fff1cfee52 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:09:45 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f384490-35bc-44a5-8aee-3308b453f2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:45 devstack sudo[114646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52 1073741824 Jun 24 10:09:45 devstack sudo[114646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1caebfc-34f5-44f8-9330-30ed8df8b0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9aad88f4-50b6-430a-bee5-29c5b7e4b9a7 tempest-SnapshotDependencyTests-129623090 None] Lock "cinder-c139d87d-a256-4cc1-a571-783184eed481-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:45 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Volume volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f (a1af9668-3ae0-49a8-8527-2ecca22c7c4f): created successfully Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1caebfc-34f5-44f8-9330-30ed8df8b0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:45 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Flow 'volume_create_manager' (6c1d1ccd-73d1-41b9-b996-e812305c47a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:09:45 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-0d896be1-289e-4273-ab27-2e8c202b0908 tempest-CinderUnicodeTest-1649824085 None] Created volume successfully. Jun 24 10:09:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-13073682-48de-4351-97e4-a2a1da9e611d tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47ec6d29-4999-4e85-8fb1-17124cbd5619" returned: 0 in 1.006s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-13073682-48de-4351-97e4-a2a1da9e611d tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47ec6d29-4999-4e85-8fb1-17124cbd5619 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:46 devstack sudo[114642]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:46 devstack sudo[114652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47ec6d29-4999-4e85-8fb1-17124cbd5619 Jun 24 10:09:46 devstack sudo[114652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:46 devstack sudo[114646]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52 1073741824" returned: 0 in 1.076s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:46 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:46 devstack sudo[114657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52 Jun 24 10:09:46 devstack sudo[114657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:47 devstack sudo[114652]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-13073682-48de-4351-97e4-a2a1da9e611d tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-47ec6d29-4999-4e85-8fb1-17124cbd5619" returned: 0 in 0.746s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-13073682-48de-4351-97e4-a2a1da9e611d tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-quobyte-47ec6d29-4999-4e85-8fb1-17124cbd5619" released by "delete_volume" :: held 1.813s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-13073682-48de-4351-97e4-a2a1da9e611d tempest-CreateVolumesFromSnapshotTest-883770034 None] Created reservations ['b652032f-55d4-4fac-bddf-9144fa6dd59b', '7a1d4213-b238-4ddd-bdd4-4918b5c057ad', 'ea131ba7-deed-4a3a-854d-01254ceee030', '14160ac1-3925-4013-bbcc-5d43eb573497'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-754e11a7-ec29-47ac-86e4-9d86cc35755d tempest-CinderUnicodeTest-1649824085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-13073682-48de-4351-97e4-a2a1da9e611d tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-13073682-48de-4351-97e4-a2a1da9e611d tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-13073682-48de-4351-97e4-a2a1da9e611d tempest-CreateVolumesFromSnapshotTest-883770034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-13073682-48de-4351-97e4-a2a1da9e611d tempest-CreateVolumesFromSnapshotTest-883770034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-13073682-48de-4351-97e4-a2a1da9e611d tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-13073682-48de-4351-97e4-a2a1da9e611d tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:47 devstack sudo[114661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:09:47 devstack sudo[114661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-cea8bbc4-5573-4096-82be-93513dea2fb9 tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "cinder-cf858ec3-10ad-4933-aadd-93ad9e83f836-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-cea8bbc4-5573-4096-82be-93513dea2fb9 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-cf858ec3-10ad-4933-aadd-93ad9e83f836-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-cea8bbc4-5573-4096-82be-93513dea2fb9 tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "cinder-quobyte-cf858ec3-10ad-4933-aadd-93ad9e83f836" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-cea8bbc4-5573-4096-82be-93513dea2fb9 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-quobyte-cf858ec3-10ad-4933-aadd-93ad9e83f836" acquired by "delete_volume" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:47 devstack sudo[114657]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52" returned: 0 in 0.868s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-754e11a7-ec29-47ac-86e4-9d86cc35755d tempest-CinderUnicodeTest-1649824085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.418s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[87df4e2d-8429-4deb-b7e1-7188441c4ef1]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cea8bbc4-5573-4096-82be-93513dea2fb9 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf858ec3-10ad-4933-aadd-93ad9e83f836 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-754e11a7-ec29-47ac-86e4-9d86cc35755d tempest-CinderUnicodeTest-1649824085 None] Creating offline snapshot 935b018e-c042-4ff7-97e3-f795738a198b of volume a1af9668-3ae0-49a8-8527-2ecca22c7c4f {{(pid=93447) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Attempting download of 39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc ((None, [{'url': 'file:///opt/stack/data/glance/images/39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc', 'metadata': {}}])) to volume 79e8dfc3-dd85-4733-9b4b-90fff1cfee52. {{(pid=93447) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d86c4b1-43ac-44ab-b511-29384bb67968]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-754e11a7-ec29-47ac-86e4-9d86cc35755d tempest-CinderUnicodeTest-1649824085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8994085c-8879-48a9-bdf0-807e5e4be1f8]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:47 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc_iyl9bqxp {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:47 devstack sudo[114664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf858ec3-10ad-4933-aadd-93ad9e83f836 Jun 24 10:09:47 devstack sudo[114664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:47 devstack sudo[114665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f Jun 24 10:09:47 devstack sudo[114665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:48 devstack sudo[114666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc_iyl9bqxp Jun 24 10:09:48 devstack sudo[114666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:48 devstack sudo[114661]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-13073682-48de-4351-97e4-a2a1da9e611d tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.910s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:48 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-13073682-48de-4351-97e4-a2a1da9e611d tempest-CreateVolumesFromSnapshotTest-883770034 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:09:48 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-13073682-48de-4351-97e4-a2a1da9e611d tempest-CreateVolumesFromSnapshotTest-883770034 None] Deleted volume successfully. Jun 24 10:09:48 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-13073682-48de-4351-97e4-a2a1da9e611d tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-47ec6d29-4999-4e85-8fb1-17124cbd5619-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:48 devstack sudo[114666]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc_iyl9bqxp" returned: 0 in 0.871s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc_iyl9bqxp {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:48 devstack sudo[114678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc_iyl9bqxp Jun 24 10:09:48 devstack sudo[114678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:48 devstack sudo[114664]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cea8bbc4-5573-4096-82be-93513dea2fb9 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf858ec3-10ad-4933-aadd-93ad9e83f836" returned: 0 in 1.138s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cea8bbc4-5573-4096-82be-93513dea2fb9 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf858ec3-10ad-4933-aadd-93ad9e83f836 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:48 devstack sudo[114681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf858ec3-10ad-4933-aadd-93ad9e83f836 Jun 24 10:09:48 devstack sudo[114681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:48 devstack sudo[114665]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-754e11a7-ec29-47ac-86e4-9d86cc35755d tempest-CinderUnicodeTest-1649824085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f" returned: 0 in 1.126s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:48 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-754e11a7-ec29-47ac-86e4-9d86cc35755d tempest-CinderUnicodeTest-1649824085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.935b018e-c042-4ff7-97e3-f795738a198b 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:48 devstack sudo[114683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.935b018e-c042-4ff7-97e3-f795738a198b 1G Jun 24 10:09:48 devstack sudo[114683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:49 devstack sudo[114678]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc_iyl9bqxp" returned: 1 in 0.913s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc_iyl9bqxp' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:09:49 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[883e5576-ecab-4a5d-8f03-beeaba6d8c6a]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:49 devstack sudo[114691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD Jun 24 10:09:49 devstack sudo[114691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:49 devstack sudo[114681]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:49 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cea8bbc4-5573-4096-82be-93513dea2fb9 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-cf858ec3-10ad-4933-aadd-93ad9e83f836" returned: 0 in 1.006s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:49 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-cea8bbc4-5573-4096-82be-93513dea2fb9 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-quobyte-cf858ec3-10ad-4933-aadd-93ad9e83f836" released by "delete_volume" :: held 2.207s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:49 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-cea8bbc4-5573-4096-82be-93513dea2fb9 tempest-CreateVolumesFromSnapshotTest-883770034 None] Created reservations ['b3060855-51bc-4d28-8689-479683c91661', '8c740db9-de6c-4fdd-9ad1-2a435bde0363', 'f0ee2a68-41b8-4ad4-95fb-88104a70bfb5', 'ca767f54-8a99-4bbf-810f-9a24ebc0bd43'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:09:50 devstack sudo[114683]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-754e11a7-ec29-47ac-86e4-9d86cc35755d tempest-CinderUnicodeTest-1649824085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.935b018e-c042-4ff7-97e3-f795738a198b 1G" returned: 0 in 1.164s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-754e11a7-ec29-47ac-86e4-9d86cc35755d tempest-CinderUnicodeTest-1649824085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.935b018e-c042-4ff7-97e3-f795738a198b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cea8bbc4-5573-4096-82be-93513dea2fb9 tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cea8bbc4-5573-4096-82be-93513dea2fb9 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cea8bbc4-5573-4096-82be-93513dea2fb9 tempest-CreateVolumesFromSnapshotTest-883770034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:50 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-cea8bbc4-5573-4096-82be-93513dea2fb9 tempest-CreateVolumesFromSnapshotTest-883770034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-cea8bbc4-5573-4096-82be-93513dea2fb9 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cea8bbc4-5573-4096-82be-93513dea2fb9 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:50 devstack sudo[114695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.935b018e-c042-4ff7-97e3-f795738a198b Jun 24 10:09:50 devstack sudo[114695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:50 devstack sudo[114696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:09:50 devstack sudo[114696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:50 devstack sudo[114691]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD" returned: 0 in 1.013s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:50 devstack sudo[114702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD Jun 24 10:09:50 devstack sudo[114702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:50 devstack sudo[114696]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-cea8bbc4-5573-4096-82be-93513dea2fb9 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.791s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:50 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-cea8bbc4-5573-4096-82be-93513dea2fb9 tempest-CreateVolumesFromSnapshotTest-883770034 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:09:50 devstack sudo[114695]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-754e11a7-ec29-47ac-86e4-9d86cc35755d tempest-CinderUnicodeTest-1649824085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f -F qcow2 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.935b018e-c042-4ff7-97e3-f795738a198b" returned: 0 in 0.823s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:50 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-754e11a7-ec29-47ac-86e4-9d86cc35755d tempest-CinderUnicodeTest-1649824085 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.935b018e-c042-4ff7-97e3-f795738a198b is being set with open permissions: ugo+rw Jun 24 10:09:50 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-754e11a7-ec29-47ac-86e4-9d86cc35755d tempest-CinderUnicodeTest-1649824085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.935b018e-c042-4ff7-97e3-f795738a198b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:50 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-cea8bbc4-5573-4096-82be-93513dea2fb9 tempest-CreateVolumesFromSnapshotTest-883770034 None] Deleted volume successfully. Jun 24 10:09:50 devstack sudo[114707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.935b018e-c042-4ff7-97e3-f795738a198b Jun 24 10:09:50 devstack sudo[114707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:51 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-cea8bbc4-5573-4096-82be-93513dea2fb9 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-cf858ec3-10ad-4933-aadd-93ad9e83f836-delete_volume" released by "delete_volume" :: held 3.382s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:51 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a7ee23ac-6e75-461f-8b90-49f4a04eefcc tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "cinder-a8957803-fc40-4adb-9c08-cbd619d0a10b-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:51 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a7ee23ac-6e75-461f-8b90-49f4a04eefcc tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-a8957803-fc40-4adb-9c08-cbd619d0a10b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:51 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a7ee23ac-6e75-461f-8b90-49f4a04eefcc tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "cinder-quobyte-a8957803-fc40-4adb-9c08-cbd619d0a10b" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:51 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a7ee23ac-6e75-461f-8b90-49f4a04eefcc tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-quobyte-a8957803-fc40-4adb-9c08-cbd619d0a10b" acquired by "delete_volume" :: waited 0.023s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:51 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1510229-4686-42e0-b02f-10a99527a54c]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a7ee23ac-6e75-461f-8b90-49f4a04eefcc tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a8957803-fc40-4adb-9c08-cbd619d0a10b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:51 devstack sudo[114709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a8957803-fc40-4adb-9c08-cbd619d0a10b Jun 24 10:09:51 devstack sudo[114709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:51 devstack sudo[114702]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD" returned: 1 in 0.930s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:09:51 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] 39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc was raw, converting to raw {{(pid=93447) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 24 10:09:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:51 devstack sudo[114716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52 Jun 24 10:09:51 devstack sudo[114716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:51 devstack sudo[114707]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-754e11a7-ec29-47ac-86e4-9d86cc35755d tempest-CinderUnicodeTest-1649824085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.935b018e-c042-4ff7-97e3-f795738a198b" returned: 0 in 0.804s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:51 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-754e11a7-ec29-47ac-86e4-9d86cc35755d tempest-CinderUnicodeTest-1649824085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:51 devstack sudo[114719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.info Jun 24 10:09:51 devstack sudo[114719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:52 devstack sudo[114709]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a7ee23ac-6e75-461f-8b90-49f4a04eefcc tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a8957803-fc40-4adb-9c08-cbd619d0a10b" returned: 0 in 0.957s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a7ee23ac-6e75-461f-8b90-49f4a04eefcc tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a8957803-fc40-4adb-9c08-cbd619d0a10b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:52 devstack sudo[114726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a8957803-fc40-4adb-9c08-cbd619d0a10b Jun 24 10:09:52 devstack sudo[114726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:52 devstack sudo[114719]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-754e11a7-ec29-47ac-86e4-9d86cc35755d tempest-CinderUnicodeTest-1649824085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.info" returned: 0 in 0.746s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:52 devstack cinder-volume[93447]: WARNING cinder.volume.drivers.remotefs [None req-754e11a7-ec29-47ac-86e4-9d86cc35755d tempest-CinderUnicodeTest-1649824085 None] /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.info is being set with open permissions: ugo+rw Jun 24 10:09:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-754e11a7-ec29-47ac-86e4-9d86cc35755d tempest-CinderUnicodeTest-1649824085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.info {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:52 devstack sudo[114732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.info Jun 24 10:09:52 devstack sudo[114732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:52 devstack sudo[114716]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52" returned: 0 in 0.985s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:52 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc__ykogix9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52 {{(pid=93447) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 24 10:09:52 devstack cinder-volume[93447]: INFO cinder.image.image_utils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Converted 0.00 MB image at 0.00 MB/s Jun 24 10:09:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52 1G {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:52 devstack sudo[114734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52 1G Jun 24 10:09:52 devstack sudo[114734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:52 devstack sudo[114726]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:52 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a7ee23ac-6e75-461f-8b90-49f4a04eefcc tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a8957803-fc40-4adb-9c08-cbd619d0a10b" returned: 0 in 0.817s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:52 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a7ee23ac-6e75-461f-8b90-49f4a04eefcc tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-quobyte-a8957803-fc40-4adb-9c08-cbd619d0a10b" released by "delete_volume" :: held 1.827s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-a7ee23ac-6e75-461f-8b90-49f4a04eefcc tempest-CreateVolumesFromSnapshotTest-883770034 None] Created reservations ['63da30b4-0ad7-47bf-b716-f785033245e2', '5ca87045-3912-4f13-b268-ea26c8842ca8', 'f71c6864-0aac-4364-a179-e6495066ad5f', 'e203d12b-34a3-4a8d-9c4d-33a6b34afd27'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a7ee23ac-6e75-461f-8b90-49f4a04eefcc tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a7ee23ac-6e75-461f-8b90-49f4a04eefcc tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a7ee23ac-6e75-461f-8b90-49f4a04eefcc tempest-CreateVolumesFromSnapshotTest-883770034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-a7ee23ac-6e75-461f-8b90-49f4a04eefcc tempest-CreateVolumesFromSnapshotTest-883770034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-a7ee23ac-6e75-461f-8b90-49f4a04eefcc tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a7ee23ac-6e75-461f-8b90-49f4a04eefcc tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:53 devstack sudo[114737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:09:53 devstack sudo[114737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:53 devstack sudo[114732]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3d5de71c-d0a4-4746-9752-a07ffca00311 tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "cinder-bbadf09f-feea-439f-b109-de91db62baf7-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-754e11a7-ec29-47ac-86e4-9d86cc35755d tempest-CinderUnicodeTest-1649824085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.info" returned: 0 in 0.903s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-754e11a7-ec29-47ac-86e4-9d86cc35755d tempest-CinderUnicodeTest-1649824085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.742s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3d5de71c-d0a4-4746-9752-a07ffca00311 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-bbadf09f-feea-439f-b109-de91db62baf7-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:53 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-754e11a7-ec29-47ac-86e4-9d86cc35755d tempest-CinderUnicodeTest-1649824085 None] Create snapshot completed successfully Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3d5de71c-d0a4-4746-9752-a07ffca00311 tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "cinder-quobyte-bbadf09f-feea-439f-b109-de91db62baf7" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3d5de71c-d0a4-4746-9752-a07ffca00311 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-quobyte-bbadf09f-feea-439f-b109-de91db62baf7" acquired by "delete_volume" :: waited 0.033s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb15612-49da-439d-9d5b-a9dedb041683]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3d5de71c-d0a4-4746-9752-a07ffca00311 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-bbadf09f-feea-439f-b109-de91db62baf7 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:53 devstack sudo[114734]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52 1G" returned: 0 in 1.081s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ac0e8a-dd7a-4953-bbc4-4e862891c366]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5dee236c-e0c2-4b8b-9c53-ecf9ff3bae4c tempest-CinderUnicodeTest-1649824085 None] Acquiring lock "cinder-935b018e-c042-4ff7-97e3-f795738a198b-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5dee236c-e0c2-4b8b-9c53-ecf9ff3bae4c tempest-CinderUnicodeTest-1649824085 None] Lock "cinder-935b018e-c042-4ff7-97e3-f795738a198b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5dee236c-e0c2-4b8b-9c53-ecf9ff3bae4c tempest-CinderUnicodeTest-1649824085 None] Acquiring lock "cinder-quobyte-a1af9668-3ae0-49a8-8527-2ecca22c7c4f" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:53 devstack sudo[114744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-bbadf09f-feea-439f-b109-de91db62baf7 Jun 24 10:09:53 devstack sudo[114744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5dee236c-e0c2-4b8b-9c53-ecf9ff3bae4c tempest-CinderUnicodeTest-1649824085 None] Lock "cinder-quobyte-a1af9668-3ae0-49a8-8527-2ecca22c7c4f" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5dee236c-e0c2-4b8b-9c53-ecf9ff3bae4c tempest-CinderUnicodeTest-1649824085 None] Acquiring lock "cinder-quobyte-935b018e-c042-4ff7-97e3-f795738a198b" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5dee236c-e0c2-4b8b-9c53-ecf9ff3bae4c tempest-CinderUnicodeTest-1649824085 None] Lock "cinder-quobyte-935b018e-c042-4ff7-97e3-f795738a198b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-5dee236c-e0c2-4b8b-9c53-ecf9ff3bae4c tempest-CinderUnicodeTest-1649824085 None] Deleting offline snapshot 935b018e-c042-4ff7-97e3-f795738a198b of volume a1af9668-3ae0-49a8-8527-2ecca22c7c4f {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-5dee236c-e0c2-4b8b-9c53-ecf9ff3bae4c tempest-CinderUnicodeTest-1649824085 None] snapshot_file for this snap is: volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.935b018e-c042-4ff7-97e3-f795738a198b {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0ff6c7-86ee-41e3-9d79-a70e6a60cc93]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:53 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5dee236c-e0c2-4b8b-9c53-ecf9ff3bae4c tempest-CinderUnicodeTest-1649824085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.935b018e-c042-4ff7-97e3-f795738a198b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:53 devstack sudo[114745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52 Jun 24 10:09:53 devstack sudo[114745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:54 devstack sudo[114747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.935b018e-c042-4ff7-97e3-f795738a198b Jun 24 10:09:54 devstack sudo[114747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:54 devstack sudo[114737]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-a7ee23ac-6e75-461f-8b90-49f4a04eefcc tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 1.162s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:54 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-a7ee23ac-6e75-461f-8b90-49f4a04eefcc tempest-CreateVolumesFromSnapshotTest-883770034 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:09:54 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-a7ee23ac-6e75-461f-8b90-49f4a04eefcc tempest-CreateVolumesFromSnapshotTest-883770034 None] Deleted volume successfully. Jun 24 10:09:54 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-a7ee23ac-6e75-461f-8b90-49f4a04eefcc tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-a8957803-fc40-4adb-9c08-cbd619d0a10b-delete_volume" released by "delete_volume" :: held 3.351s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:54 devstack sudo[114744]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3d5de71c-d0a4-4746-9752-a07ffca00311 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-bbadf09f-feea-439f-b109-de91db62baf7" returned: 0 in 1.232s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3d5de71c-d0a4-4746-9752-a07ffca00311 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-bbadf09f-feea-439f-b109-de91db62baf7 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:54 devstack sudo[114763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-bbadf09f-feea-439f-b109-de91db62baf7 Jun 24 10:09:54 devstack sudo[114763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:54 devstack sudo[114745]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52" returned: 0 in 1.180s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:54 devstack sudo[114747]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:54 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5dee236c-e0c2-4b8b-9c53-ecf9ff3bae4c tempest-CinderUnicodeTest-1649824085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.935b018e-c042-4ff7-97e3-f795738a198b" returned: 0 in 1.060s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:54 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-5dee236c-e0c2-4b8b-9c53-ecf9ff3bae4c tempest-CinderUnicodeTest-1649824085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:09:55 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb19ece-f3ce-4202-99ed-2a2413f20992]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5dee236c-e0c2-4b8b-9c53-ecf9ff3bae4c tempest-CinderUnicodeTest-1649824085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:55 devstack sudo[114765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52 Jun 24 10:09:55 devstack sudo[114765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:55 devstack sudo[114766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f Jun 24 10:09:55 devstack sudo[114766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:55 devstack sudo[114763]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3d5de71c-d0a4-4746-9752-a07ffca00311 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-bbadf09f-feea-439f-b109-de91db62baf7" returned: 0 in 0.856s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:55 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3d5de71c-d0a4-4746-9752-a07ffca00311 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-quobyte-bbadf09f-feea-439f-b109-de91db62baf7" released by "delete_volume" :: held 2.180s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:55 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-3d5de71c-d0a4-4746-9752-a07ffca00311 tempest-CreateVolumesFromSnapshotTest-883770034 None] Created reservations ['96adea82-6a69-4da4-8e87-59f503ab9ce1', '395b9341-1750-4497-acaa-5ed9bdcbddc0', '2f7dd88d-b474-43b7-9e7c-886a6b487aac', '6ec7b987-4d24-472f-860f-fb92de22cf8f'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:09:55 devstack sudo[114765]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52" returned: 1 in 0.950s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:09:55 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Downloaded image 39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc ((None, [{'url': 'file:///opt/stack/data/glance/images/39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc', 'metadata': {}}])) to volume 79e8dfc3-dd85-4733-9b4b-90fff1cfee52 successfully. {{(pid=93447) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 24 10:09:55 devstack cinder-volume[93447]: DEBUG cinder.image.image_utils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Temporary image 39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc for user 32508cfe131e4a52a590bcfcc00a372c is deleted. {{(pid=93447) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 24 10:09:55 devstack cinder-volume[93447]: DEBUG cinder.volume.volume_utils [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Marking volume 79e8dfc3-dd85-4733-9b4b-90fff1cfee52 as bootable. {{(pid=93447) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 24 10:09:55 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Copying metadata from image 39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc to 79e8dfc3-dd85-4733-9b4b-90fff1cfee52. {{(pid=93447) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 24 10:09:55 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Creating volume glance metadata for volume 79e8dfc3-dd85-4733-9b4b-90fff1cfee52 backed by image 39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc with: {'image_id': '39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1d71347af92a86d4f277eb5aceb5b186', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93447) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 24 10:09:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3d5de71c-d0a4-4746-9752-a07ffca00311 tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:55 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3d5de71c-d0a4-4746-9752-a07ffca00311 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:55 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3d5de71c-d0a4-4746-9752-a07ffca00311 tempest-CreateVolumesFromSnapshotTest-883770034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:56 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3d5de71c-d0a4-4746-9752-a07ffca00311 tempest-CreateVolumesFromSnapshotTest-883770034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3d5de71c-d0a4-4746-9752-a07ffca00311 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3d5de71c-d0a4-4746-9752-a07ffca00311 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:56 devstack sudo[114776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:09:56 devstack sudo[114776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:56 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c5ce340-d3af-408f-a271-e6f29c11c11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52', 'volume_size': 1, 'image_id': '39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1d71347af92a86d4f277eb5aceb5b186', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd58cfc7baeb547769835756d1bd79370', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fb727e5a4d977bb32790d776b24d26af7480a2e1a75bd2cedef29e2705e0693bfa037a99a2baeb233b768ae981a2b43e40947a1ad283f841f4a9e4c9268f242a', 'id': '39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc', 'created_at': datetime.datetime(2026, 6, 24, 8, 9, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 24, 8, 9, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/39750d3f-6b6b-4057-8ce3-01b2fa1b0ddc/file', 'properties': {}}, 'image_service': }' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:56 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c80dee7-bc3b-4654-a034-217d08d593ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:09:56 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Volume volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52 (79e8dfc3-dd85-4733-9b4b-90fff1cfee52): created successfully Jun 24 10:09:56 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c80dee7-bc3b-4654-a034-217d08d593ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:09:56 devstack sudo[114766]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:56 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Flow 'volume_create_manager' (85a5ec87-f559-4139-a8f4-86b45ea8cb5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:09:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5dee236c-e0c2-4b8b-9c53-ecf9ff3bae4c tempest-CinderUnicodeTest-1649824085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f" returned: 0 in 1.081s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5dee236c-e0c2-4b8b-9c53-ecf9ff3bae4c tempest-CinderUnicodeTest-1649824085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.935b018e-c042-4ff7-97e3-f795738a198b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:56 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-f6d482ba-cc72-4b57-ba1c-59cc19c62102 tempest-VolumeImageDependencyTests-917712504 None] Created volume successfully. Jun 24 10:09:56 devstack sudo[114778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.935b018e-c042-4ff7-97e3-f795738a198b Jun 24 10:09:56 devstack sudo[114778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:56 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-950e0496-be03-4147-9dc3-a072663266d6 tempest-VolumeImageDependencyTests-917712504 None] Acquiring lock "cinder-79e8dfc3-dd85-4733-9b4b-90fff1cfee52-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:56 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-950e0496-be03-4147-9dc3-a072663266d6 tempest-VolumeImageDependencyTests-917712504 None] Lock "cinder-79e8dfc3-dd85-4733-9b4b-90fff1cfee52-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:56 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-950e0496-be03-4147-9dc3-a072663266d6 tempest-VolumeImageDependencyTests-917712504 None] Acquiring lock "cinder-quobyte-79e8dfc3-dd85-4733-9b4b-90fff1cfee52" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:56 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-950e0496-be03-4147-9dc3-a072663266d6 tempest-VolumeImageDependencyTests-917712504 None] Lock "cinder-quobyte-79e8dfc3-dd85-4733-9b4b-90fff1cfee52" acquired by "delete_volume" :: waited 0.022s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:56 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80a4c82-dca9-446c-9ec3-2ec6053f4f2f]: (4, 'raw') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-950e0496-be03-4147-9dc3-a072663266d6 tempest-VolumeImageDependencyTests-917712504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:56 devstack sudo[114780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52 Jun 24 10:09:56 devstack sudo[114780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:56 devstack sudo[114776]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:56 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3d5de71c-d0a4-4746-9752-a07ffca00311 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.927s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:56 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-3d5de71c-d0a4-4746-9752-a07ffca00311 tempest-CreateVolumesFromSnapshotTest-883770034 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:09:56 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-3d5de71c-d0a4-4746-9752-a07ffca00311 tempest-CreateVolumesFromSnapshotTest-883770034 None] Deleted volume successfully. Jun 24 10:09:56 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1cbf2014-60a5-4f14-aeac-0d1cad2eeac8 tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "cinder-b6c536ef-26ce-425c-b3d6-25edad7bbcfa-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:56 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-3d5de71c-d0a4-4746-9752-a07ffca00311 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-bbadf09f-feea-439f-b109-de91db62baf7-delete_volume" released by "delete_volume" :: held 3.488s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:57 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1cbf2014-60a5-4f14-aeac-0d1cad2eeac8 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-b6c536ef-26ce-425c-b3d6-25edad7bbcfa-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:57 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1cbf2014-60a5-4f14-aeac-0d1cad2eeac8 tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "cinder-quobyte-b6c536ef-26ce-425c-b3d6-25edad7bbcfa" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:57 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1cbf2014-60a5-4f14-aeac-0d1cad2eeac8 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-quobyte-b6c536ef-26ce-425c-b3d6-25edad7bbcfa" acquired by "delete_volume" :: waited 0.023s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:57 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e076afba-4bcd-4ebc-ae07-5f5c8f6b0a0d]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1cbf2014-60a5-4f14-aeac-0d1cad2eeac8 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b6c536ef-26ce-425c-b3d6-25edad7bbcfa {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:57 devstack sudo[114778]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5dee236c-e0c2-4b8b-9c53-ecf9ff3bae4c tempest-CinderUnicodeTest-1649824085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.935b018e-c042-4ff7-97e3-f795738a198b" returned: 0 in 1.093s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5dee236c-e0c2-4b8b-9c53-ecf9ff3bae4c tempest-CinderUnicodeTest-1649824085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.935b018e-c042-4ff7-97e3-f795738a198b {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:57 devstack sudo[114787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.935b018e-c042-4ff7-97e3-f795738a198b Jun 24 10:09:57 devstack sudo[114787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:57 devstack sudo[114786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b6c536ef-26ce-425c-b3d6-25edad7bbcfa Jun 24 10:09:57 devstack sudo[114786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:57 devstack sudo[114780]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-950e0496-be03-4147-9dc3-a072663266d6 tempest-VolumeImageDependencyTests-917712504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52" returned: 0 in 1.001s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-950e0496-be03-4147-9dc3-a072663266d6 tempest-VolumeImageDependencyTests-917712504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:57 devstack sudo[114792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52 Jun 24 10:09:57 devstack sudo[114792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:57 devstack sudo[114787]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5dee236c-e0c2-4b8b-9c53-ecf9ff3bae4c tempest-CinderUnicodeTest-1649824085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f.935b018e-c042-4ff7-97e3-f795738a198b" returned: 0 in 0.704s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:57 devstack sudo[114786]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1cbf2014-60a5-4f14-aeac-0d1cad2eeac8 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b6c536ef-26ce-425c-b3d6-25edad7bbcfa" returned: 0 in 0.819s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:57 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1cbf2014-60a5-4f14-aeac-0d1cad2eeac8 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b6c536ef-26ce-425c-b3d6-25edad7bbcfa {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:57 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5dee236c-e0c2-4b8b-9c53-ecf9ff3bae4c tempest-CinderUnicodeTest-1649824085 None] Lock "cinder-quobyte-935b018e-c042-4ff7-97e3-f795738a198b" released by "_delete_snapshot" :: held 4.080s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:57 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5dee236c-e0c2-4b8b-9c53-ecf9ff3bae4c tempest-CinderUnicodeTest-1649824085 None] Lock "cinder-quobyte-a1af9668-3ae0-49a8-8527-2ecca22c7c4f" released by "delete_snapshot" :: held 4.114s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:57 devstack sudo[114799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b6c536ef-26ce-425c-b3d6-25edad7bbcfa Jun 24 10:09:57 devstack sudo[114799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:58 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-5dee236c-e0c2-4b8b-9c53-ecf9ff3bae4c tempest-CinderUnicodeTest-1649824085 None] Created reservations ['c6c4a562-d9e6-4522-ae15-4793e4858ad5', 'a2211c36-099c-4618-aa21-ca0b4f4dd5c2', 'a6495592-0066-4404-ba01-15e4a54c7e85', 'a3092b7e-2709-4952-903c-601e8c515cd7'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:09:58 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-5dee236c-e0c2-4b8b-9c53-ecf9ff3bae4c tempest-CinderUnicodeTest-1649824085 None] Delete snapshot completed successfully. Jun 24 10:09:58 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-5dee236c-e0c2-4b8b-9c53-ecf9ff3bae4c tempest-CinderUnicodeTest-1649824085 None] Lock "cinder-935b018e-c042-4ff7-97e3-f795738a198b-delete_snapshot" released by "delete_snapshot" :: held 4.292s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:58 devstack sudo[114792]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-950e0496-be03-4147-9dc3-a072663266d6 tempest-VolumeImageDependencyTests-917712504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52" returned: 1 in 0.832s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-950e0496-be03-4147-9dc3-a072663266d6 tempest-VolumeImageDependencyTests-917712504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52' failed. Not Retrying. {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 24 10:09:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-950e0496-be03-4147-9dc3-a072663266d6 tempest-VolumeImageDependencyTests-917712504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:58 devstack sudo[114805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52 Jun 24 10:09:58 devstack sudo[114805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:58 devstack sudo[114799]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1cbf2014-60a5-4f14-aeac-0d1cad2eeac8 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-b6c536ef-26ce-425c-b3d6-25edad7bbcfa" returned: 0 in 0.657s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:58 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1cbf2014-60a5-4f14-aeac-0d1cad2eeac8 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-quobyte-b6c536ef-26ce-425c-b3d6-25edad7bbcfa" released by "delete_volume" :: held 1.530s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:58 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-1cbf2014-60a5-4f14-aeac-0d1cad2eeac8 tempest-CreateVolumesFromSnapshotTest-883770034 None] Created reservations ['4f6e8228-7e68-4d5a-bfae-a6965a3810a7', 'a0e15c66-7689-416c-86ac-9cc3fd5e2dcb', '89cba4a0-0899-4805-aece-02d44b593c91', 'fd72babe-f982-4442-a50a-0f17913a07f5'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:09:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1cbf2014-60a5-4f14-aeac-0d1cad2eeac8 tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1cbf2014-60a5-4f14-aeac-0d1cad2eeac8 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:58 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1cbf2014-60a5-4f14-aeac-0d1cad2eeac8 tempest-CreateVolumesFromSnapshotTest-883770034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:58 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1cbf2014-60a5-4f14-aeac-0d1cad2eeac8 tempest-CreateVolumesFromSnapshotTest-883770034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1cbf2014-60a5-4f14-aeac-0d1cad2eeac8 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:58 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1cbf2014-60a5-4f14-aeac-0d1cad2eeac8 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:58 devstack sudo[114807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:09:58 devstack sudo[114807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-bfad11b8-2bb6-4d1c-8567-b47387863608 tempest-CinderUnicodeTest-1649824085 None] Acquiring lock "cinder-a1af9668-3ae0-49a8-8527-2ecca22c7c4f-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:59 devstack sudo[114805]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-950e0496-be03-4147-9dc3-a072663266d6 tempest-VolumeImageDependencyTests-917712504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-79e8dfc3-dd85-4733-9b4b-90fff1cfee52" returned: 0 in 0.713s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-bfad11b8-2bb6-4d1c-8567-b47387863608 tempest-CinderUnicodeTest-1649824085 None] Lock "cinder-a1af9668-3ae0-49a8-8527-2ecca22c7c4f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-950e0496-be03-4147-9dc3-a072663266d6 tempest-VolumeImageDependencyTests-917712504 None] Lock "cinder-quobyte-79e8dfc3-dd85-4733-9b4b-90fff1cfee52" released by "delete_volume" :: held 2.671s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-bfad11b8-2bb6-4d1c-8567-b47387863608 tempest-CinderUnicodeTest-1649824085 None] Acquiring lock "cinder-quobyte-a1af9668-3ae0-49a8-8527-2ecca22c7c4f" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-58d9f1e8-f15b-4da4-9943-0baa842d7ae7 tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "cinder-31783c1c-55e4-4d2b-bcec-f24ef0808407-delete_snapshot" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-bfad11b8-2bb6-4d1c-8567-b47387863608 tempest-CinderUnicodeTest-1649824085 None] Lock "cinder-quobyte-a1af9668-3ae0-49a8-8527-2ecca22c7c4f" acquired by "delete_volume" :: waited 0.032s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-58d9f1e8-f15b-4da4-9943-0baa842d7ae7 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-31783c1c-55e4-4d2b-bcec-f24ef0808407-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-58d9f1e8-f15b-4da4-9943-0baa842d7ae7 tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "cinder-quobyte-7811a67d-2813-424d-a617-3a0451072ff0" by "delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-950e0496-be03-4147-9dc3-a072663266d6 tempest-VolumeImageDependencyTests-917712504 None] Created reservations ['ebcb192f-d5e6-4cc0-8ef1-2164708cb88e', '83d7d223-6898-44c2-b4f4-bd40edaf0e56', 'f0b9203a-95a8-48cc-b126-b319d56fd7b9', '93c09370-5b26-4485-9545-d3b0b45f9a99'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e533bfb-45ce-4f05-9419-da1224588e50]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bfad11b8-2bb6-4d1c-8567-b47387863608 tempest-CinderUnicodeTest-1649824085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-58d9f1e8-f15b-4da4-9943-0baa842d7ae7 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-quobyte-7811a67d-2813-424d-a617-3a0451072ff0" acquired by "delete_snapshot" :: waited 0.039s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-58d9f1e8-f15b-4da4-9943-0baa842d7ae7 tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "cinder-quobyte-31783c1c-55e4-4d2b-bcec-f24ef0808407" by "_delete_snapshot" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-58d9f1e8-f15b-4da4-9943-0baa842d7ae7 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-quobyte-31783c1c-55e4-4d2b-bcec-f24ef0808407" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-58d9f1e8-f15b-4da4-9943-0baa842d7ae7 tempest-CreateVolumesFromSnapshotTest-883770034 None] Deleting offline snapshot 31783c1c-55e4-4d2b-bcec-f24ef0808407 of volume 7811a67d-2813-424d-a617-3a0451072ff0 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 24 10:09:59 devstack sudo[114807]: pam_unix(sudo:session): session closed for user root Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-58d9f1e8-f15b-4da4-9943-0baa842d7ae7 tempest-CreateVolumesFromSnapshotTest-883770034 None] snapshot_file for this snap is: volume-7811a67d-2813-424d-a617-3a0451072ff0.31783c1c-55e4-4d2b-bcec-f24ef0808407 {{(pid=93447) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1cbf2014-60a5-4f14-aeac-0d1cad2eeac8 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.707s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-1cbf2014-60a5-4f14-aeac-0d1cad2eeac8 tempest-CreateVolumesFromSnapshotTest-883770034 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:09:59 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-1cbf2014-60a5-4f14-aeac-0d1cad2eeac8 tempest-CreateVolumesFromSnapshotTest-883770034 None] Deleted volume successfully. Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1fe776-7c63-4f9a-a933-efbc56b97b9a]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-58d9f1e8-f15b-4da4-9943-0baa842d7ae7 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.31783c1c-55e4-4d2b-bcec-f24ef0808407 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:59 devstack sudo[114811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f Jun 24 10:09:59 devstack sudo[114811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1cbf2014-60a5-4f14-aeac-0d1cad2eeac8 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-b6c536ef-26ce-425c-b3d6-25edad7bbcfa-delete_volume" released by "delete_volume" :: held 2.494s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-950e0496-be03-4147-9dc3-a072663266d6 tempest-VolumeImageDependencyTests-917712504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-950e0496-be03-4147-9dc3-a072663266d6 tempest-VolumeImageDependencyTests-917712504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-950e0496-be03-4147-9dc3-a072663266d6 tempest-VolumeImageDependencyTests-917712504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-950e0496-be03-4147-9dc3-a072663266d6 tempest-VolumeImageDependencyTests-917712504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-950e0496-be03-4147-9dc3-a072663266d6 tempest-VolumeImageDependencyTests-917712504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:09:59 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-950e0496-be03-4147-9dc3-a072663266d6 tempest-VolumeImageDependencyTests-917712504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:09:59 devstack sudo[114814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:09:59 devstack sudo[114814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:09:59 devstack sudo[114812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.31783c1c-55e4-4d2b-bcec-f24ef0808407 Jun 24 10:09:59 devstack sudo[114812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:00 devstack sudo[114811]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bfad11b8-2bb6-4d1c-8567-b47387863608 tempest-CinderUnicodeTest-1649824085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f" returned: 0 in 0.832s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bfad11b8-2bb6-4d1c-8567-b47387863608 tempest-CinderUnicodeTest-1649824085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:00 devstack sudo[114823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f Jun 24 10:10:00 devstack sudo[114823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:00 devstack sudo[114814]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-950e0496-be03-4147-9dc3-a072663266d6 tempest-VolumeImageDependencyTests-917712504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.816s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:00 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-950e0496-be03-4147-9dc3-a072663266d6 tempest-VolumeImageDependencyTests-917712504 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:10:00 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-950e0496-be03-4147-9dc3-a072663266d6 tempest-VolumeImageDependencyTests-917712504 None] Deleted volume successfully. Jun 24 10:10:00 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-950e0496-be03-4147-9dc3-a072663266d6 tempest-VolumeImageDependencyTests-917712504 None] Lock "cinder-79e8dfc3-dd85-4733-9b4b-90fff1cfee52-delete_volume" released by "delete_volume" :: held 3.891s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:10:00 devstack sudo[114812]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-58d9f1e8-f15b-4da4-9943-0baa842d7ae7 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.31783c1c-55e4-4d2b-bcec-f24ef0808407" returned: 0 in 0.965s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:00 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-58d9f1e8-f15b-4da4-9943-0baa842d7ae7 tempest-CreateVolumesFromSnapshotTest-883770034 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7811a67d-2813-424d-a617-3a0451072ff0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93447) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 24 10:10:00 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb081fa-e645-4692-9ac5-c426b7ec2177]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:10:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-58d9f1e8-f15b-4da4-9943-0baa842d7ae7 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:00 devstack sudo[114826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0 Jun 24 10:10:00 devstack sudo[114826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:00 devstack sudo[114823]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:00 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bfad11b8-2bb6-4d1c-8567-b47387863608 tempest-CinderUnicodeTest-1649824085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a1af9668-3ae0-49a8-8527-2ecca22c7c4f" returned: 0 in 0.793s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:00 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-bfad11b8-2bb6-4d1c-8567-b47387863608 tempest-CinderUnicodeTest-1649824085 None] Lock "cinder-quobyte-a1af9668-3ae0-49a8-8527-2ecca22c7c4f" released by "delete_volume" :: held 1.696s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:10:01 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-bfad11b8-2bb6-4d1c-8567-b47387863608 tempest-CinderUnicodeTest-1649824085 None] Created reservations ['00162693-f0ec-44eb-bde3-b6f3dcbce45a', '06456d7c-4487-4f81-bf34-1c74b5fdcd95', 'bb187f6d-bf96-492e-b017-aaa445fdf77a', '884f617d-2c56-44a3-8aae-c8b6a9cd64f7'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:10:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-bfad11b8-2bb6-4d1c-8567-b47387863608 tempest-CinderUnicodeTest-1649824085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:10:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-bfad11b8-2bb6-4d1c-8567-b47387863608 tempest-CinderUnicodeTest-1649824085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:10:01 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-bfad11b8-2bb6-4d1c-8567-b47387863608 tempest-CinderUnicodeTest-1649824085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:10:01 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-bfad11b8-2bb6-4d1c-8567-b47387863608 tempest-CinderUnicodeTest-1649824085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:10:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-bfad11b8-2bb6-4d1c-8567-b47387863608 tempest-CinderUnicodeTest-1649824085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:10:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bfad11b8-2bb6-4d1c-8567-b47387863608 tempest-CinderUnicodeTest-1649824085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:01 devstack sudo[114830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:10:01 devstack sudo[114830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:01 devstack sudo[114826]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-58d9f1e8-f15b-4da4-9943-0baa842d7ae7 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0" returned: 0 in 0.880s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-58d9f1e8-f15b-4da4-9943-0baa842d7ae7 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.31783c1c-55e4-4d2b-bcec-f24ef0808407 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:01 devstack sudo[114835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.31783c1c-55e4-4d2b-bcec-f24ef0808407 Jun 24 10:10:01 devstack sudo[114835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:01 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1f46d630-268e-4084-aa7a-80cc22632d04 tempest-CinderUnicodeTest-1649824085 None] Acquiring lock "cinder-a549dab1-ac64-46ad-91f9-15724615756c-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:10:01 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1f46d630-268e-4084-aa7a-80cc22632d04 tempest-CinderUnicodeTest-1649824085 None] Lock "cinder-a549dab1-ac64-46ad-91f9-15724615756c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:10:01 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1f46d630-268e-4084-aa7a-80cc22632d04 tempest-CinderUnicodeTest-1649824085 None] Acquiring lock "cinder-quobyte-a549dab1-ac64-46ad-91f9-15724615756c" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:10:01 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1f46d630-268e-4084-aa7a-80cc22632d04 tempest-CinderUnicodeTest-1649824085 None] Lock "cinder-quobyte-a549dab1-ac64-46ad-91f9-15724615756c" acquired by "delete_volume" :: waited 0.027s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:10:01 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cf591b-018b-4b3d-a412-d32673442538]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:10:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1f46d630-268e-4084-aa7a-80cc22632d04 tempest-CinderUnicodeTest-1649824085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a549dab1-ac64-46ad-91f9-15724615756c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:01 devstack sudo[114837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a549dab1-ac64-46ad-91f9-15724615756c Jun 24 10:10:01 devstack sudo[114837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:01 devstack sudo[114830]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:01 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-bfad11b8-2bb6-4d1c-8567-b47387863608 tempest-CinderUnicodeTest-1649824085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.754s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:01 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-bfad11b8-2bb6-4d1c-8567-b47387863608 tempest-CinderUnicodeTest-1649824085 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:10:01 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-bfad11b8-2bb6-4d1c-8567-b47387863608 tempest-CinderUnicodeTest-1649824085 None] Deleted volume successfully. Jun 24 10:10:01 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-bfad11b8-2bb6-4d1c-8567-b47387863608 tempest-CinderUnicodeTest-1649824085 None] Lock "cinder-a1af9668-3ae0-49a8-8527-2ecca22c7c4f-delete_volume" released by "delete_volume" :: held 2.708s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:10:02 devstack sudo[114835]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-58d9f1e8-f15b-4da4-9943-0baa842d7ae7 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.31783c1c-55e4-4d2b-bcec-f24ef0808407" returned: 0 in 0.862s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-58d9f1e8-f15b-4da4-9943-0baa842d7ae7 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.31783c1c-55e4-4d2b-bcec-f24ef0808407 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:02 devstack sudo[114844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.31783c1c-55e4-4d2b-bcec-f24ef0808407 Jun 24 10:10:02 devstack sudo[114844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:02 devstack sudo[114837]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1f46d630-268e-4084-aa7a-80cc22632d04 tempest-CinderUnicodeTest-1649824085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a549dab1-ac64-46ad-91f9-15724615756c" returned: 0 in 0.846s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1f46d630-268e-4084-aa7a-80cc22632d04 tempest-CinderUnicodeTest-1649824085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a549dab1-ac64-46ad-91f9-15724615756c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:02 devstack sudo[114849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a549dab1-ac64-46ad-91f9-15724615756c Jun 24 10:10:02 devstack sudo[114849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:02 devstack sudo[114844]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:02 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-58d9f1e8-f15b-4da4-9943-0baa842d7ae7 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0.31783c1c-55e4-4d2b-bcec-f24ef0808407" returned: 0 in 0.651s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-58d9f1e8-f15b-4da4-9943-0baa842d7ae7 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-quobyte-31783c1c-55e4-4d2b-bcec-f24ef0808407" released by "_delete_snapshot" :: held 3.500s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:10:02 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-58d9f1e8-f15b-4da4-9943-0baa842d7ae7 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-quobyte-7811a67d-2813-424d-a617-3a0451072ff0" released by "delete_snapshot" :: held 3.539s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:10:03 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-58d9f1e8-f15b-4da4-9943-0baa842d7ae7 tempest-CreateVolumesFromSnapshotTest-883770034 None] Created reservations ['96e13b5e-6259-460a-a3e9-cbd0dbc7b847', 'd67aa9a3-a1d1-4681-a0e8-561e2616b311', '2013d070-b334-44b2-a117-e8038c60b590', '1de47386-b018-4c73-98a3-9f1c64010bad'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:10:03 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-58d9f1e8-f15b-4da4-9943-0baa842d7ae7 tempest-CreateVolumesFromSnapshotTest-883770034 None] Delete snapshot completed successfully. Jun 24 10:10:03 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-58d9f1e8-f15b-4da4-9943-0baa842d7ae7 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-31783c1c-55e4-4d2b-bcec-f24ef0808407-delete_snapshot" released by "delete_snapshot" :: held 3.759s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:10:03 devstack sudo[114849]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1f46d630-268e-4084-aa7a-80cc22632d04 tempest-CinderUnicodeTest-1649824085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-a549dab1-ac64-46ad-91f9-15724615756c" returned: 0 in 0.664s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:03 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1f46d630-268e-4084-aa7a-80cc22632d04 tempest-CinderUnicodeTest-1649824085 None] Lock "cinder-quobyte-a549dab1-ac64-46ad-91f9-15724615756c" released by "delete_volume" :: held 1.566s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:10:03 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-1f46d630-268e-4084-aa7a-80cc22632d04 tempest-CinderUnicodeTest-1649824085 None] Created reservations ['70509f87-5f7c-4601-8384-11db8da8c695', 'fddd485c-2b13-4a58-9dc9-a56faf057d67', '822d1ffd-008c-436c-9644-b5d8dbb8656f', 'd77fe86c-0937-4331-9446-1d33e0179262'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:10:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1f46d630-268e-4084-aa7a-80cc22632d04 tempest-CinderUnicodeTest-1649824085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:10:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1f46d630-268e-4084-aa7a-80cc22632d04 tempest-CinderUnicodeTest-1649824085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:10:03 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1f46d630-268e-4084-aa7a-80cc22632d04 tempest-CinderUnicodeTest-1649824085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:10:03 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-1f46d630-268e-4084-aa7a-80cc22632d04 tempest-CinderUnicodeTest-1649824085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:10:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-1f46d630-268e-4084-aa7a-80cc22632d04 tempest-CinderUnicodeTest-1649824085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:10:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1f46d630-268e-4084-aa7a-80cc22632d04 tempest-CinderUnicodeTest-1649824085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:03 devstack sudo[114856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:10:03 devstack sudo[114856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:03 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0af069ec-21db-4fcf-9ce5-54a30d97b514 tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "cinder-7811a67d-2813-424d-a617-3a0451072ff0-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:10:03 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0af069ec-21db-4fcf-9ce5-54a30d97b514 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-7811a67d-2813-424d-a617-3a0451072ff0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:10:03 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0af069ec-21db-4fcf-9ce5-54a30d97b514 tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "cinder-quobyte-7811a67d-2813-424d-a617-3a0451072ff0" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:10:03 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0af069ec-21db-4fcf-9ce5-54a30d97b514 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-quobyte-7811a67d-2813-424d-a617-3a0451072ff0" acquired by "delete_volume" :: waited 0.014s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:10:03 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[913c2fa1-fbce-48a0-bf7b-d6b814d2eec3]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:10:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0af069ec-21db-4fcf-9ce5-54a30d97b514 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:03 devstack sudo[114861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0 Jun 24 10:10:03 devstack sudo[114861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:03 devstack sudo[114856]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:03 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-1f46d630-268e-4084-aa7a-80cc22632d04 tempest-CinderUnicodeTest-1649824085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.679s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:03 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-1f46d630-268e-4084-aa7a-80cc22632d04 tempest-CinderUnicodeTest-1649824085 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:10:03 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-1f46d630-268e-4084-aa7a-80cc22632d04 tempest-CinderUnicodeTest-1649824085 None] Deleted volume successfully. Jun 24 10:10:03 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-1f46d630-268e-4084-aa7a-80cc22632d04 tempest-CinderUnicodeTest-1649824085 None] Lock "cinder-a549dab1-ac64-46ad-91f9-15724615756c-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:10:04 devstack sudo[114861]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0af069ec-21db-4fcf-9ce5-54a30d97b514 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0" returned: 0 in 0.774s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:04 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0af069ec-21db-4fcf-9ce5-54a30d97b514 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:04 devstack sudo[114867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0 Jun 24 10:10:04 devstack sudo[114867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:05 devstack sudo[114867]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0af069ec-21db-4fcf-9ce5-54a30d97b514 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-7811a67d-2813-424d-a617-3a0451072ff0" returned: 0 in 0.690s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0af069ec-21db-4fcf-9ce5-54a30d97b514 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-quobyte-7811a67d-2813-424d-a617-3a0451072ff0" released by "delete_volume" :: held 1.540s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:10:05 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-0af069ec-21db-4fcf-9ce5-54a30d97b514 tempest-CreateVolumesFromSnapshotTest-883770034 None] Created reservations ['f66ec749-2470-45f6-922d-8363686e561e', 'a8a2511b-b6b9-46d0-af7f-186dabab7632', '45732f9f-1eef-442d-9fd1-9edee67eb156', '48d6d259-7e9c-4fea-90d0-4d89fa0bac81'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:10:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0af069ec-21db-4fcf-9ce5-54a30d97b514 tempest-CreateVolumesFromSnapshotTest-883770034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:10:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0af069ec-21db-4fcf-9ce5-54a30d97b514 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:10:05 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0af069ec-21db-4fcf-9ce5-54a30d97b514 tempest-CreateVolumesFromSnapshotTest-883770034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:10:05 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0af069ec-21db-4fcf-9ce5-54a30d97b514 tempest-CreateVolumesFromSnapshotTest-883770034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:10:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0af069ec-21db-4fcf-9ce5-54a30d97b514 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:10:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0af069ec-21db-4fcf-9ce5-54a30d97b514 tempest-CreateVolumesFromSnapshotTest-883770034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:05 devstack sudo[114870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:10:05 devstack sudo[114870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:05 devstack sudo[114870]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:05 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0af069ec-21db-4fcf-9ce5-54a30d97b514 tempest-CreateVolumesFromSnapshotTest-883770034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.633s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:05 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-0af069ec-21db-4fcf-9ce5-54a30d97b514 tempest-CreateVolumesFromSnapshotTest-883770034 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:10:05 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-0af069ec-21db-4fcf-9ce5-54a30d97b514 tempest-CreateVolumesFromSnapshotTest-883770034 None] Deleted volume successfully. Jun 24 10:10:05 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0af069ec-21db-4fcf-9ce5-54a30d97b514 tempest-CreateVolumesFromSnapshotTest-883770034 None] Lock "cinder-7811a67d-2813-424d-a617-3a0451072ff0-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:10:08 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:10:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Flow 'volume_create_manager' (cc57a00a-2bea-4fee-b64c-4a7434fc16d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:10:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (431b545b-d942-4e25-b3d7-3961389c2459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (431b545b-d942-4e25-b3d7-3961389c2459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-471240429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9278070d-e53d-4aa3-a4a7-a9bc2d47a678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1df87a12134de6ae9c1efe95d649b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:10:08Z,use_quota=True,user_id='1e3073450af84a96a213af88c35ae929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6c7f94-6b79-463b-a9e8-af14f08ae68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6c7f94-6b79-463b-a9e8-af14f08ae68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9289bab5-feef-4fba-b3ca-aba9683b79d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9289bab5-feef-4fba-b3ca-aba9683b79d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9278070d-e53d-4aa3-a4a7-a9bc2d47a678', 'volume_name': 'volume-9278070d-e53d-4aa3-a4a7-a9bc2d47a678', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a32a6aa8-3771-46cd-956c-ac9fca06e747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a32a6aa8-3771-46cd-956c-ac9fca06e747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:08 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92425dc-b209-4f7d-824a-e8fc700b227f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:08 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Volume 9278070d-e53d-4aa3-a4a7-a9bc2d47a678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9278070d-e53d-4aa3-a4a7-a9bc2d47a678', 'volume_size': 1} Jun 24 10:10:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:10:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:10:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-471240429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9278070d-e53d-4aa3-a4a7-a9bc2d47a678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1df87a12134de6ae9c1efe95d649b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:10:08Z,use_quota=True,user_id='1e3073450af84a96a213af88c35ae929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:10:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Creating volume 9278070d-e53d-4aa3-a4a7-a9bc2d47a678 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:10:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:10:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:10:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:10:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:10:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:10:08 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:10:08 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:10:08 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9278070d-e53d-4aa3-a4a7-a9bc2d47a678 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:08 devstack sudo[114873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9278070d-e53d-4aa3-a4a7-a9bc2d47a678 1073741824 Jun 24 10:10:08 devstack sudo[114873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:09 devstack sudo[114873]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9278070d-e53d-4aa3-a4a7-a9bc2d47a678 1073741824" returned: 0 in 0.853s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9278070d-e53d-4aa3-a4a7-a9bc2d47a678 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:09 devstack sudo[114879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9278070d-e53d-4aa3-a4a7-a9bc2d47a678 Jun 24 10:10:09 devstack sudo[114879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:09 devstack sudo[114879]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9278070d-e53d-4aa3-a4a7-a9bc2d47a678" returned: 0 in 0.634s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:09 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:10:09 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92425dc-b209-4f7d-824a-e8fc700b227f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9278070d-e53d-4aa3-a4a7-a9bc2d47a678', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f69045b2-7a9a-429d-8b89-f841a0661f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:10 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Volume volume-9278070d-e53d-4aa3-a4a7-a9bc2d47a678 (9278070d-e53d-4aa3-a4a7-a9bc2d47a678): created successfully Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f69045b2-7a9a-429d-8b89-f841a0661f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Flow 'volume_create_manager' (cc57a00a-2bea-4fee-b64c-4a7434fc16d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:10:10 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-5e8c0986-3692-4cad-a514-96a8c9de78bd tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Created volume successfully. Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Flow 'volume_create_manager' (a0e06140-df2d-4d9f-9932-1e2c6f5191db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26695e5b-801c-4193-b2ce-a5bb53c0d109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26695e5b-801c-4193-b2ce-a5bb53c0d109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2075554290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a452ac-d240-4ab2-acc8-bcf406b5e9c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1df87a12134de6ae9c1efe95d649b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:10:11Z,use_quota=True,user_id='1e3073450af84a96a213af88c35ae929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1a8171-9929-461d-889d-c0e621658b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1a8171-9929-461d-889d-c0e621658b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b3b5e1-a2dc-4ace-a955-5f1897dc11c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1b3b5e1-a2dc-4ace-a955-5f1897dc11c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4a452ac-d240-4ab2-acc8-bcf406b5e9c6', 'volume_name': 'volume-d4a452ac-d240-4ab2-acc8-bcf406b5e9c6', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ef8a28-5aa8-49b7-9e4a-048b6457a8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ef8a28-5aa8-49b7-9e4a-048b6457a8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72fcba3a-af09-47d2-ae3c-3ce2604d21a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:10 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Volume d4a452ac-d240-4ab2-acc8-bcf406b5e9c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4a452ac-d240-4ab2-acc8-bcf406b5e9c6', 'volume_size': 1} Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2075554290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a452ac-d240-4ab2-acc8-bcf406b5e9c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1df87a12134de6ae9c1efe95d649b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:10:11Z,use_quota=True,user_id='1e3073450af84a96a213af88c35ae929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Creating volume d4a452ac-d240-4ab2-acc8-bcf406b5e9c6 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:10:10 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:10:10 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d4a452ac-d240-4ab2-acc8-bcf406b5e9c6 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:10 devstack sudo[114882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d4a452ac-d240-4ab2-acc8-bcf406b5e9c6 1073741824 Jun 24 10:10:10 devstack sudo[114882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Flow 'volume_create_manager' (b6cb300b-4196-45d9-9570-c0fef33b515d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35509ab0-19da-493f-949b-ff25eb55e60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35509ab0-19da-493f-949b-ff25eb55e60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1009582340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1600b023-89ea-4e70-a19b-b71397324d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1df87a12134de6ae9c1efe95d649b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:10:11Z,use_quota=True,user_id='1e3073450af84a96a213af88c35ae929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586b2cb8-d123-4eea-86ee-055a756d28e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586b2cb8-d123-4eea-86ee-055a756d28e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (783a2c18-e401-4809-aecf-55d7edc6b212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (783a2c18-e401-4809-aecf-55d7edc6b212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1600b023-89ea-4e70-a19b-b71397324d8c', 'volume_name': 'volume-1600b023-89ea-4e70-a19b-b71397324d8c', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a1ccad-7c42-4b85-a8e8-17e5250ec5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a1ccad-7c42-4b85-a8e8-17e5250ec5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430e2ef0-1b20-4331-b2e2-dd9bb38b4edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:11 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Volume 1600b023-89ea-4e70-a19b-b71397324d8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1600b023-89ea-4e70-a19b-b71397324d8c', 'volume_size': 1} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Flow 'volume_create_manager' (2f215c16-9406-4b56-8177-a559bbccef30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4f11afc-bfa4-4c88-8035-be55bc17339b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4f11afc-bfa4-4c88-8035-be55bc17339b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-455545802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e129ec01-3ba9-4da4-8044-201140353113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1df87a12134de6ae9c1efe95d649b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:10:12Z,use_quota=True,user_id='1e3073450af84a96a213af88c35ae929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab1f8ff-6dde-412b-b43e-93b318936284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab1f8ff-6dde-412b-b43e-93b318936284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df722978-3edc-4b0e-bbe9-def681671770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df722978-3edc-4b0e-bbe9-def681671770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e129ec01-3ba9-4da4-8044-201140353113', 'volume_name': 'volume-e129ec01-3ba9-4da4-8044-201140353113', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f44114-e814-4b54-bc23-3570a121edd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f44114-e814-4b54-bc23-3570a121edd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d764c712-f919-4bdc-a475-d74220eba17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:11 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Volume e129ec01-3ba9-4da4-8044-201140353113: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e129ec01-3ba9-4da4-8044-201140353113', 'volume_size': 1} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:10:11 devstack sudo[114882]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d4a452ac-d240-4ab2-acc8-bcf406b5e9c6 1073741824" returned: 0 in 0.900s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d4a452ac-d240-4ab2-acc8-bcf406b5e9c6 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:11 devstack sudo[114887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d4a452ac-d240-4ab2-acc8-bcf406b5e9c6 Jun 24 10:10:11 devstack sudo[114887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:10:11 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Flow 'volume_create_manager' (8cd8d3b7-535a-420f-9875-bbd67b744a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9eae2c-fdf3-4bf2-b26c-bc806bdfdd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9eae2c-fdf3-4bf2-b26c-bc806bdfdd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1477622874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfdd3fa4-e4f9-4739-bd8b-a3f673818113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1df87a12134de6ae9c1efe95d649b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:10:12Z,use_quota=True,user_id='1e3073450af84a96a213af88c35ae929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9b74ac-6339-4b49-ab7d-50c6525fd488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9b74ac-6339-4b49-ab7d-50c6525fd488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca3cbc2-a0d7-4949-9a3d-e7814d4c67d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca3cbc2-a0d7-4949-9a3d-e7814d4c67d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfdd3fa4-e4f9-4739-bd8b-a3f673818113', 'volume_name': 'volume-dfdd3fa4-e4f9-4739-bd8b-a3f673818113', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ada6e3b-7f03-4e53-8db9-83854fa98d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ada6e3b-7f03-4e53-8db9-83854fa98d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f63dda-f8f3-41cd-88ca-f2e267d0f058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:12 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Volume dfdd3fa4-e4f9-4739-bd8b-a3f673818113: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfdd3fa4-e4f9-4739-bd8b-a3f673818113', 'volume_size': 1} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93447) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Flow 'volume_create_manager' (841e136f-f75e-4e9c-8b76-3e896185db20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13a06c0c-0977-4c2a-b839-d29f5a9b5b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13a06c0c-0977-4c2a-b839-d29f5a9b5b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-345540725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b94d491-6b89-43a0-83f5-683e959a3586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1df87a12134de6ae9c1efe95d649b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:10:12Z,use_quota=True,user_id='1e3073450af84a96a213af88c35ae929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470006c8-70fe-4998-bca8-f2bd41e25044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470006c8-70fe-4998-bca8-f2bd41e25044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fece13f-be0d-4e72-9261-d4968f2d1e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fece13f-be0d-4e72-9261-d4968f2d1e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b94d491-6b89-43a0-83f5-683e959a3586', 'volume_name': 'volume-3b94d491-6b89-43a0-83f5-683e959a3586', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba75b03f-b582-4113-876b-68213a7f65ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba75b03f-b582-4113-876b-68213a7f65ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e329414a-c43e-4c8f-9f44-add39118a69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:12 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Volume 3b94d491-6b89-43a0-83f5-683e959a3586: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b94d491-6b89-43a0-83f5-683e959a3586', 'volume_size': 1} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:10:12 devstack sudo[114887]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d4a452ac-d240-4ab2-acc8-bcf406b5e9c6" returned: 0 in 0.694s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.285s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1009582340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1600b023-89ea-4e70-a19b-b71397324d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1df87a12134de6ae9c1efe95d649b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:10:11Z,use_quota=True,user_id='1e3073450af84a96a213af88c35ae929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Creating volume 1600b023-89ea-4e70-a19b-b71397324d8c {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:10:12 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1600b023-89ea-4e70-a19b-b71397324d8c 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:12 devstack sudo[114891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1600b023-89ea-4e70-a19b-b71397324d8c 1073741824 Jun 24 10:10:12 devstack sudo[114891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72fcba3a-af09-47d2-ae3c-3ce2604d21a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4a452ac-d240-4ab2-acc8-bcf406b5e9c6', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf823c51-998c-41ad-b8b7-dd5709ec1978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:12 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Volume volume-d4a452ac-d240-4ab2-acc8-bcf406b5e9c6 (d4a452ac-d240-4ab2-acc8-bcf406b5e9c6): created successfully Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf823c51-998c-41ad-b8b7-dd5709ec1978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:12 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Flow 'volume_create_manager' (a0e06140-df2d-4d9f-9932-1e2c6f5191db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:10:12 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-25248fd2-666a-492d-b274-c8944a10774d tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Created volume successfully. Jun 24 10:10:13 devstack sudo[114891]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1600b023-89ea-4e70-a19b-b71397324d8c 1073741824" returned: 0 in 0.846s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:13 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1600b023-89ea-4e70-a19b-b71397324d8c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:13 devstack sudo[114899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1600b023-89ea-4e70-a19b-b71397324d8c Jun 24 10:10:13 devstack sudo[114899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:14 devstack sudo[114899]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1600b023-89ea-4e70-a19b-b71397324d8c" returned: 0 in 0.615s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:14 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:10:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:10:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.435s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:10:14 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-455545802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e129ec01-3ba9-4da4-8044-201140353113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1df87a12134de6ae9c1efe95d649b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:10:12Z,use_quota=True,user_id='1e3073450af84a96a213af88c35ae929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:10:14 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Creating volume e129ec01-3ba9-4da4-8044-201140353113 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:10:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:10:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:10:14 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:10:14 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:10:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:10:14 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:10:14 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:10:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e129ec01-3ba9-4da4-8044-201140353113 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:14 devstack sudo[114902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e129ec01-3ba9-4da4-8044-201140353113 1073741824 Jun 24 10:10:14 devstack sudo[114902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:14 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430e2ef0-1b20-4331-b2e2-dd9bb38b4edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1600b023-89ea-4e70-a19b-b71397324d8c', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:14 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2ede49-928c-4b5e-bfdd-1c3718ebc202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:14 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Volume volume-1600b023-89ea-4e70-a19b-b71397324d8c (1600b023-89ea-4e70-a19b-b71397324d8c): created successfully Jun 24 10:10:14 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2ede49-928c-4b5e-bfdd-1c3718ebc202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:14 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Flow 'volume_create_manager' (b6cb300b-4196-45d9-9570-c0fef33b515d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:10:14 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-6a40ba75-ddde-4a3d-b18b-a5bde532971f tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Created volume successfully. Jun 24 10:10:14 devstack sudo[114902]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e129ec01-3ba9-4da4-8044-201140353113 1073741824" returned: 0 in 0.814s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:14 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e129ec01-3ba9-4da4-8044-201140353113 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:14 devstack sudo[114907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e129ec01-3ba9-4da4-8044-201140353113 Jun 24 10:10:14 devstack sudo[114907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:15 devstack sudo[114907]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e129ec01-3ba9-4da4-8044-201140353113" returned: 0 in 0.638s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:15 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:10:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:10:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.536s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:10:15 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1477622874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfdd3fa4-e4f9-4739-bd8b-a3f673818113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1df87a12134de6ae9c1efe95d649b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:10:12Z,use_quota=True,user_id='1e3073450af84a96a213af88c35ae929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:10:15 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Creating volume dfdd3fa4-e4f9-4739-bd8b-a3f673818113 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:10:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:10:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:10:15 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:10:15 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:10:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:10:15 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:10:15 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:10:15 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-dfdd3fa4-e4f9-4739-bd8b-a3f673818113 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d764c712-f919-4bdc-a475-d74220eba17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e129ec01-3ba9-4da4-8044-201140353113', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:15 devstack sudo[114910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-dfdd3fa4-e4f9-4739-bd8b-a3f673818113 1073741824 Jun 24 10:10:15 devstack sudo[114910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3f4936-b7d1-40fd-96ef-ffb4a962073a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:15 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Volume volume-e129ec01-3ba9-4da4-8044-201140353113 (e129ec01-3ba9-4da4-8044-201140353113): created successfully Jun 24 10:10:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3f4936-b7d1-40fd-96ef-ffb4a962073a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:15 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Flow 'volume_create_manager' (2f215c16-9406-4b56-8177-a559bbccef30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:10:15 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-4a7fac15-d2fd-4f6a-aea0-61db2c080512 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Created volume successfully. Jun 24 10:10:16 devstack sudo[114910]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-dfdd3fa4-e4f9-4739-bd8b-a3f673818113 1073741824" returned: 0 in 0.811s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:16 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-dfdd3fa4-e4f9-4739-bd8b-a3f673818113 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:16 devstack sudo[114915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-dfdd3fa4-e4f9-4739-bd8b-a3f673818113 Jun 24 10:10:16 devstack sudo[114915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:17 devstack sudo[114915]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-dfdd3fa4-e4f9-4739-bd8b-a3f673818113" returned: 0 in 0.612s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:17 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:10:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:10:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.677s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:10:17 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-24T08:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-345540725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b94d491-6b89-43a0-83f5-683e959a3586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1df87a12134de6ae9c1efe95d649b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-24T08:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-24T08:10:12Z,use_quota=True,user_id='1e3073450af84a96a213af88c35ae929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ef85e75-d735-4a01-9e64-ff50a9eb29b1),volume_type_id=1ef85e75-d735-4a01-9e64-ff50a9eb29b1)}" {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 24 10:10:17 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.remotefs [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Creating volume 3b94d491-6b89-43a0-83f5-683e959a3586 {{(pid=93447) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 24 10:10:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:10:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:10:17 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:10:17 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:10:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:10:17 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Selected osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb as target Quobyte volume. {{(pid=93447) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 24 10:10:17 devstack cinder-volume[93447]: INFO cinder.volume.drivers.remotefs [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] casted to osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb Jun 24 10:10:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3b94d491-6b89-43a0-83f5-683e959a3586 1073741824 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:17 devstack sudo[114918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3b94d491-6b89-43a0-83f5-683e959a3586 1073741824 Jun 24 10:10:17 devstack sudo[114918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f63dda-f8f3-41cd-88ca-f2e267d0f058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfdd3fa4-e4f9-4739-bd8b-a3f673818113', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3be93ed5-2493-4026-b301-60c55a1a8ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:17 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Volume volume-dfdd3fa4-e4f9-4739-bd8b-a3f673818113 (dfdd3fa4-e4f9-4739-bd8b-a3f673818113): created successfully Jun 24 10:10:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3be93ed5-2493-4026-b301-60c55a1a8ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:17 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Flow 'volume_create_manager' (8cd8d3b7-535a-420f-9875-bbd67b744a71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:10:17 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-fcb70aa8-a19d-4219-b32b-64ee3d9952da tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Created volume successfully. Jun 24 10:10:17 devstack sudo[114918]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3b94d491-6b89-43a0-83f5-683e959a3586 1073741824" returned: 0 in 0.827s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:17 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3b94d491-6b89-43a0-83f5-683e959a3586 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:17 devstack sudo[114924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3b94d491-6b89-43a0-83f5-683e959a3586 Jun 24 10:10:17 devstack sudo[114924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:18 devstack sudo[114924]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3b94d491-6b89-43a0-83f5-683e959a3586" returned: 0 in 0.694s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:18 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'} {{(pid=93447) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 24 10:10:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:10:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e329414a-c43e-4c8f-9f44-add39118a69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b94d491-6b89-43a0-83f5-683e959a3586', 'volume_size': 1}' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e0fbe2e-9dfc-4dcf-98e2-05ab945f46d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 24 10:10:18 devstack cinder-volume[93447]: INFO cinder.volume.flows.manager.create_volume [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Volume volume-3b94d491-6b89-43a0-83f5-683e959a3586 (3b94d491-6b89-43a0-83f5-683e959a3586): created successfully Jun 24 10:10:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e0fbe2e-9dfc-4dcf-98e2-05ab945f46d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93447) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 24 10:10:18 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Flow 'volume_create_manager' (841e136f-f75e-4e9c-8b76-3e896185db20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93447) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 24 10:10:18 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-3f433b90-f832-4e1d-a61f-372d2f28e44a tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Created volume successfully. Jun 24 10:10:18 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9c80f0fa-147e-4be8-b737-40e5e4170023 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "cinder-3b94d491-6b89-43a0-83f5-683e959a3586-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:10:18 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9c80f0fa-147e-4be8-b737-40e5e4170023 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "cinder-3b94d491-6b89-43a0-83f5-683e959a3586-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:10:18 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9c80f0fa-147e-4be8-b737-40e5e4170023 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "cinder-quobyte-3b94d491-6b89-43a0-83f5-683e959a3586" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:10:18 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9c80f0fa-147e-4be8-b737-40e5e4170023 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "cinder-quobyte-3b94d491-6b89-43a0-83f5-683e959a3586" acquired by "delete_volume" :: waited 0.016s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:10:18 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8f913c-bd10-4e2a-96e5-b412a041c6bb]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:10:18 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9c80f0fa-147e-4be8-b737-40e5e4170023 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3b94d491-6b89-43a0-83f5-683e959a3586 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:19 devstack sudo[114927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3b94d491-6b89-43a0-83f5-683e959a3586 Jun 24 10:10:19 devstack sudo[114927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:19 devstack sudo[114927]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9c80f0fa-147e-4be8-b737-40e5e4170023 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3b94d491-6b89-43a0-83f5-683e959a3586" returned: 0 in 0.767s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:19 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9c80f0fa-147e-4be8-b737-40e5e4170023 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3b94d491-6b89-43a0-83f5-683e959a3586 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:19 devstack sudo[114932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3b94d491-6b89-43a0-83f5-683e959a3586 Jun 24 10:10:19 devstack sudo[114932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:20 devstack sudo[114932]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9c80f0fa-147e-4be8-b737-40e5e4170023 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-3b94d491-6b89-43a0-83f5-683e959a3586" returned: 0 in 0.624s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:20 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9c80f0fa-147e-4be8-b737-40e5e4170023 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "cinder-quobyte-3b94d491-6b89-43a0-83f5-683e959a3586" released by "delete_volume" :: held 1.437s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:10:20 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-9c80f0fa-147e-4be8-b737-40e5e4170023 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Created reservations ['bbb25525-a519-4572-bfc1-d26f597de759', 'f26e9361-b55d-4069-aa47-b473cb2ad452', '395a9ec0-9731-4e02-b7be-b3b734bbf7a7', 'd11055c2-0c96-42c9-a14d-388a4f10e4b1'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:10:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9c80f0fa-147e-4be8-b737-40e5e4170023 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:10:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9c80f0fa-147e-4be8-b737-40e5e4170023 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:10:20 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9c80f0fa-147e-4be8-b737-40e5e4170023 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:10:20 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-9c80f0fa-147e-4be8-b737-40e5e4170023 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:10:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-9c80f0fa-147e-4be8-b737-40e5e4170023 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:10:20 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9c80f0fa-147e-4be8-b737-40e5e4170023 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:20 devstack sudo[114935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:10:20 devstack sudo[114935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:21 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f309d899-728b-4696-bb18-5c06bbb5dab8 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "cinder-dfdd3fa4-e4f9-4739-bd8b-a3f673818113-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:10:21 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f309d899-728b-4696-bb18-5c06bbb5dab8 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "cinder-dfdd3fa4-e4f9-4739-bd8b-a3f673818113-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:10:21 devstack sudo[114935]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-9c80f0fa-147e-4be8-b737-40e5e4170023 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.648s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:21 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-9c80f0fa-147e-4be8-b737-40e5e4170023 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:10:21 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f309d899-728b-4696-bb18-5c06bbb5dab8 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "cinder-quobyte-dfdd3fa4-e4f9-4739-bd8b-a3f673818113" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:10:21 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-9c80f0fa-147e-4be8-b737-40e5e4170023 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Deleted volume successfully. Jun 24 10:10:21 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f309d899-728b-4696-bb18-5c06bbb5dab8 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "cinder-quobyte-dfdd3fa4-e4f9-4739-bd8b-a3f673818113" acquired by "delete_volume" :: waited 0.021s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:10:21 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-9c80f0fa-147e-4be8-b737-40e5e4170023 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "cinder-3b94d491-6b89-43a0-83f5-683e959a3586-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:10:21 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[432e7f8a-2126-4c93-be3c-51f3558e7548]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:10:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f309d899-728b-4696-bb18-5c06bbb5dab8 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-dfdd3fa4-e4f9-4739-bd8b-a3f673818113 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:21 devstack sudo[114938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-dfdd3fa4-e4f9-4739-bd8b-a3f673818113 Jun 24 10:10:21 devstack sudo[114938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:21 devstack sudo[114938]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f309d899-728b-4696-bb18-5c06bbb5dab8 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-dfdd3fa4-e4f9-4739-bd8b-a3f673818113" returned: 0 in 0.755s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:21 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f309d899-728b-4696-bb18-5c06bbb5dab8 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-dfdd3fa4-e4f9-4739-bd8b-a3f673818113 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:21 devstack sudo[114943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-dfdd3fa4-e4f9-4739-bd8b-a3f673818113 Jun 24 10:10:21 devstack sudo[114943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:22 devstack sudo[114943]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f309d899-728b-4696-bb18-5c06bbb5dab8 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-dfdd3fa4-e4f9-4739-bd8b-a3f673818113" returned: 0 in 0.688s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:22 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f309d899-728b-4696-bb18-5c06bbb5dab8 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "cinder-quobyte-dfdd3fa4-e4f9-4739-bd8b-a3f673818113" released by "delete_volume" :: held 1.480s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:10:22 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-f309d899-728b-4696-bb18-5c06bbb5dab8 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Created reservations ['38d07222-b4f4-469e-af41-311d99fd49de', '83e27fb6-c401-4e99-a992-62a2b52ff52d', '380a0833-a660-4d85-9b49-bf19fbf69d68', '92ef1004-a11d-4af8-b051-d1d03e811f0e'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:10:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f309d899-728b-4696-bb18-5c06bbb5dab8 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:10:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f309d899-728b-4696-bb18-5c06bbb5dab8 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:10:22 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f309d899-728b-4696-bb18-5c06bbb5dab8 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:10:22 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-f309d899-728b-4696-bb18-5c06bbb5dab8 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:10:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-f309d899-728b-4696-bb18-5c06bbb5dab8 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:10:22 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f309d899-728b-4696-bb18-5c06bbb5dab8 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:22 devstack sudo[114947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:10:22 devstack sudo[114947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e54218ce-be67-4cd1-91cf-b9cfeaeaf2ca tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "cinder-e129ec01-3ba9-4da4-8044-201140353113-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:10:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e54218ce-be67-4cd1-91cf-b9cfeaeaf2ca tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "cinder-e129ec01-3ba9-4da4-8044-201140353113-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:10:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e54218ce-be67-4cd1-91cf-b9cfeaeaf2ca tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "cinder-quobyte-e129ec01-3ba9-4da4-8044-201140353113" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:10:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e54218ce-be67-4cd1-91cf-b9cfeaeaf2ca tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "cinder-quobyte-e129ec01-3ba9-4da4-8044-201140353113" acquired by "delete_volume" :: waited 0.015s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:10:23 devstack sudo[114947]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-f309d899-728b-4696-bb18-5c06bbb5dab8 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.651s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:23 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-f309d899-728b-4696-bb18-5c06bbb5dab8 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:10:23 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57ab095-fb34-4d37-97e7-afc89a154b6a]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:10:23 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e54218ce-be67-4cd1-91cf-b9cfeaeaf2ca tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e129ec01-3ba9-4da4-8044-201140353113 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:23 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-f309d899-728b-4696-bb18-5c06bbb5dab8 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Deleted volume successfully. Jun 24 10:10:23 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-f309d899-728b-4696-bb18-5c06bbb5dab8 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "cinder-dfdd3fa4-e4f9-4739-bd8b-a3f673818113-delete_volume" released by "delete_volume" :: held 2.349s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:10:23 devstack sudo[114950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e129ec01-3ba9-4da4-8044-201140353113 Jun 24 10:10:23 devstack sudo[114950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:24 devstack sudo[114950]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e54218ce-be67-4cd1-91cf-b9cfeaeaf2ca tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e129ec01-3ba9-4da4-8044-201140353113" returned: 0 in 0.721s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e54218ce-be67-4cd1-91cf-b9cfeaeaf2ca tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e129ec01-3ba9-4da4-8044-201140353113 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:24 devstack sudo[114955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e129ec01-3ba9-4da4-8044-201140353113 Jun 24 10:10:24 devstack sudo[114955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:24 devstack sudo[114955]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e54218ce-be67-4cd1-91cf-b9cfeaeaf2ca tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-e129ec01-3ba9-4da4-8044-201140353113" returned: 0 in 0.650s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:24 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e54218ce-be67-4cd1-91cf-b9cfeaeaf2ca tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "cinder-quobyte-e129ec01-3ba9-4da4-8044-201140353113" released by "delete_volume" :: held 1.415s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:10:24 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-e54218ce-be67-4cd1-91cf-b9cfeaeaf2ca tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Created reservations ['6bce1f1f-513f-4623-90e7-8296a9e8901b', 'f05c3430-54a0-4a55-a534-0736ef175f43', 'c7de3d76-6f91-49ec-8642-021129e0ed1a', '758da754-90f6-423b-b065-d14a7999a48a'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:10:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e54218ce-be67-4cd1-91cf-b9cfeaeaf2ca tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:10:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e54218ce-be67-4cd1-91cf-b9cfeaeaf2ca tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:10:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-e54218ce-be67-4cd1-91cf-b9cfeaeaf2ca tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:10:24 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-e54218ce-be67-4cd1-91cf-b9cfeaeaf2ca tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:10:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-e54218ce-be67-4cd1-91cf-b9cfeaeaf2ca tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:10:24 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e54218ce-be67-4cd1-91cf-b9cfeaeaf2ca tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:24 devstack sudo[114958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:10:24 devstack sudo[114958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 10:10:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:10:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:10:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:10:25 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:10:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:10:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:25 devstack sudo[114960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:10:25 devstack sudo[114960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:25 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-553b7156-f3fd-4c52-a624-935ddf8679bf tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "cinder-1600b023-89ea-4e70-a19b-b71397324d8c-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:10:25 devstack sudo[114958]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-e54218ce-be67-4cd1-91cf-b9cfeaeaf2ca tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.643s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-e54218ce-be67-4cd1-91cf-b9cfeaeaf2ca tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:10:25 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-e54218ce-be67-4cd1-91cf-b9cfeaeaf2ca tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Deleted volume successfully. Jun 24 10:10:25 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-553b7156-f3fd-4c52-a624-935ddf8679bf tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "cinder-1600b023-89ea-4e70-a19b-b71397324d8c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:10:25 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-e54218ce-be67-4cd1-91cf-b9cfeaeaf2ca tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "cinder-e129ec01-3ba9-4da4-8044-201140353113-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:10:25 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-553b7156-f3fd-4c52-a624-935ddf8679bf tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "cinder-quobyte-1600b023-89ea-4e70-a19b-b71397324d8c" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:10:25 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-553b7156-f3fd-4c52-a624-935ddf8679bf tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "cinder-quobyte-1600b023-89ea-4e70-a19b-b71397324d8c" acquired by "delete_volume" :: waited 0.016s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:10:25 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4526e7c-43e2-48ae-818a-4caaee621f1f]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:10:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-553b7156-f3fd-4c52-a624-935ddf8679bf tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1600b023-89ea-4e70-a19b-b71397324d8c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:25 devstack sudo[114960]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:25 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.645s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:25 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:10:25 devstack cinder-volume[93447]: DEBUG oslo_service.periodic_task [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] Running periodic task VolumeManager._thread_info {{(pid=93447) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 24 10:10:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread count: 28 {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 24 10:10:25 devstack cinder-volume[93447]: DEBUG cinder.volume.manager [None req-2762340b-4055-46d1-81ef-66df89da70cd None None] thread info: [<_MainThread(MainThread, started 131470828269696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93447) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 24 10:10:25 devstack sudo[114964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1600b023-89ea-4e70-a19b-b71397324d8c Jun 24 10:10:25 devstack sudo[114964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:26 devstack sudo[114964]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-553b7156-f3fd-4c52-a624-935ddf8679bf tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1600b023-89ea-4e70-a19b-b71397324d8c" returned: 0 in 0.804s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:26 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-553b7156-f3fd-4c52-a624-935ddf8679bf tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1600b023-89ea-4e70-a19b-b71397324d8c {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:26 devstack sudo[114969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1600b023-89ea-4e70-a19b-b71397324d8c Jun 24 10:10:26 devstack sudo[114969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:27 devstack sudo[114969]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-553b7156-f3fd-4c52-a624-935ddf8679bf tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-1600b023-89ea-4e70-a19b-b71397324d8c" returned: 0 in 0.618s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-553b7156-f3fd-4c52-a624-935ddf8679bf tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "cinder-quobyte-1600b023-89ea-4e70-a19b-b71397324d8c" released by "delete_volume" :: held 1.462s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:10:27 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-553b7156-f3fd-4c52-a624-935ddf8679bf tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Created reservations ['e656fc22-a8fb-4e38-a933-46f526dbe04c', 'accda2c7-482e-477c-b627-6191fdc0f71b', '24c08d9e-fc24-4da9-ae3b-6be1c811ee89', 'b1ca1eff-fcbc-4a64-83bc-c4bafcae7521'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:10:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-553b7156-f3fd-4c52-a624-935ddf8679bf tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:10:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-553b7156-f3fd-4c52-a624-935ddf8679bf tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:10:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-553b7156-f3fd-4c52-a624-935ddf8679bf tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:10:27 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-553b7156-f3fd-4c52-a624-935ddf8679bf tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:10:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-553b7156-f3fd-4c52-a624-935ddf8679bf tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:10:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-553b7156-f3fd-4c52-a624-935ddf8679bf tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:27 devstack sudo[114972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:10:27 devstack sudo[114972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0c07ab5c-57d3-48c6-ae99-f5ae84e56c04 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "cinder-d4a452ac-d240-4ab2-acc8-bcf406b5e9c6-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:10:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0c07ab5c-57d3-48c6-ae99-f5ae84e56c04 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "cinder-d4a452ac-d240-4ab2-acc8-bcf406b5e9c6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:10:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0c07ab5c-57d3-48c6-ae99-f5ae84e56c04 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "cinder-quobyte-d4a452ac-d240-4ab2-acc8-bcf406b5e9c6" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:10:27 devstack sudo[114972]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0c07ab5c-57d3-48c6-ae99-f5ae84e56c04 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "cinder-quobyte-d4a452ac-d240-4ab2-acc8-bcf406b5e9c6" acquired by "delete_volume" :: waited 0.021s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:10:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-553b7156-f3fd-4c52-a624-935ddf8679bf tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.661s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:27 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-553b7156-f3fd-4c52-a624-935ddf8679bf tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:10:27 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-553b7156-f3fd-4c52-a624-935ddf8679bf tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Deleted volume successfully. Jun 24 10:10:27 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce88965-9e3e-4a93-ac0d-f41499421332]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:10:27 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0c07ab5c-57d3-48c6-ae99-f5ae84e56c04 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d4a452ac-d240-4ab2-acc8-bcf406b5e9c6 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:27 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-553b7156-f3fd-4c52-a624-935ddf8679bf tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "cinder-1600b023-89ea-4e70-a19b-b71397324d8c-delete_volume" released by "delete_volume" :: held 2.349s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:10:28 devstack sudo[114975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d4a452ac-d240-4ab2-acc8-bcf406b5e9c6 Jun 24 10:10:28 devstack sudo[114975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:28 devstack sudo[114975]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0c07ab5c-57d3-48c6-ae99-f5ae84e56c04 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d4a452ac-d240-4ab2-acc8-bcf406b5e9c6" returned: 0 in 0.794s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:28 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0c07ab5c-57d3-48c6-ae99-f5ae84e56c04 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d4a452ac-d240-4ab2-acc8-bcf406b5e9c6 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:28 devstack sudo[114980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d4a452ac-d240-4ab2-acc8-bcf406b5e9c6 Jun 24 10:10:28 devstack sudo[114980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:29 devstack sudo[114980]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0c07ab5c-57d3-48c6-ae99-f5ae84e56c04 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-d4a452ac-d240-4ab2-acc8-bcf406b5e9c6" returned: 0 in 0.622s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:29 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0c07ab5c-57d3-48c6-ae99-f5ae84e56c04 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "cinder-quobyte-d4a452ac-d240-4ab2-acc8-bcf406b5e9c6" released by "delete_volume" :: held 1.469s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:10:29 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-0c07ab5c-57d3-48c6-ae99-f5ae84e56c04 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Created reservations ['2b94ed92-9a19-4957-bf31-ddade021d690', '7ccd830d-c12c-4dbf-ba28-37e83e3adb59', 'f0f9ee8f-c065-46cf-b9e2-7f814af23c18', 'd779a3b6-50b3-434c-97f2-373b74af8229'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:10:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0c07ab5c-57d3-48c6-ae99-f5ae84e56c04 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:10:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0c07ab5c-57d3-48c6-ae99-f5ae84e56c04 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:10:29 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0c07ab5c-57d3-48c6-ae99-f5ae84e56c04 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:10:29 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-0c07ab5c-57d3-48c6-ae99-f5ae84e56c04 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:10:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-0c07ab5c-57d3-48c6-ae99-f5ae84e56c04 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:10:29 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0c07ab5c-57d3-48c6-ae99-f5ae84e56c04 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:29 devstack sudo[115017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:10:29 devstack sudo[115017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:30 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fb6080f8-9032-4d22-b7ec-9a8650cbf53e tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "cinder-9278070d-e53d-4aa3-a4a7-a9bc2d47a678-delete_volume" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:10:30 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fb6080f8-9032-4d22-b7ec-9a8650cbf53e tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "cinder-9278070d-e53d-4aa3-a4a7-a9bc2d47a678-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:10:30 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fb6080f8-9032-4d22-b7ec-9a8650cbf53e tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "cinder-quobyte-9278070d-e53d-4aa3-a4a7-a9bc2d47a678" by "delete_volume" {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 24 10:10:30 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fb6080f8-9032-4d22-b7ec-9a8650cbf53e tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "cinder-quobyte-9278070d-e53d-4aa3-a4a7-a9bc2d47a678" acquired by "delete_volume" :: waited 0.016s {{(pid=93447) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 24 10:10:30 devstack sudo[115017]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-0c07ab5c-57d3-48c6-ae99-f5ae84e56c04 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.634s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:30 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-0c07ab5c-57d3-48c6-ae99-f5ae84e56c04 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:10:30 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-0c07ab5c-57d3-48c6-ae99-f5ae84e56c04 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Deleted volume successfully. Jun 24 10:10:30 devstack cinder-volume[93447]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1fdbaa-a8c4-44ec-8540-f962bbcfa650]: (4, 'qcow2') {{(pid=94801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 24 10:10:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fb6080f8-9032-4d22-b7ec-9a8650cbf53e tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9278070d-e53d-4aa3-a4a7-a9bc2d47a678 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:30 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-0c07ab5c-57d3-48c6-ae99-f5ae84e56c04 tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "cinder-d4a452ac-d240-4ab2-acc8-bcf406b5e9c6-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:10:30 devstack sudo[115022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9278070d-e53d-4aa3-a4a7-a9bc2d47a678 Jun 24 10:10:30 devstack sudo[115022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:30 devstack sudo[115022]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fb6080f8-9032-4d22-b7ec-9a8650cbf53e tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9278070d-e53d-4aa3-a4a7-a9bc2d47a678" returned: 0 in 0.718s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:30 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fb6080f8-9032-4d22-b7ec-9a8650cbf53e tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9278070d-e53d-4aa3-a4a7-a9bc2d47a678 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:30 devstack sudo[115027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9278070d-e53d-4aa3-a4a7-a9bc2d47a678 Jun 24 10:10:30 devstack sudo[115027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:31 devstack sudo[115027]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fb6080f8-9032-4d22-b7ec-9a8650cbf53e tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447/volume-9278070d-e53d-4aa3-a4a7-a9bc2d47a678" returned: 0 in 0.621s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:31 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fb6080f8-9032-4d22-b7ec-9a8650cbf53e tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "cinder-quobyte-9278070d-e53d-4aa3-a4a7-a9bc2d47a678" released by "delete_volume" :: held 1.384s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:10:31 devstack cinder-volume[93447]: DEBUG cinder.quota [None req-fb6080f8-9032-4d22-b7ec-9a8650cbf53e tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Created reservations ['4f347fa1-9140-4b8c-9d9c-0c3e6d08b6f0', '727c13c0-b551-48e0-923c-04331d2726a3', '36d18273-5c3d-4c21-b9f8-127e2f22a2b0', '4696adee-22cf-4195-889a-b34073490c76'] {{(pid=93447) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 24 10:10:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-fb6080f8-9032-4d22-b7ec-9a8650cbf53e tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 24 10:10:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-fb6080f8-9032-4d22-b7ec-9a8650cbf53e tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 24 10:10:31 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-fb6080f8-9032-4d22-b7ec-9a8650cbf53e tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb': None} {{(pid=93447) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 24 10:10:31 devstack cinder-volume[93447]: DEBUG cinder.volume.drivers.quobyte [None req-fb6080f8-9032-4d22-b7ec-9a8650cbf53e tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b3a7cd6d-c193-4c2d-9b32-dfd9149b3fcb'] {{(pid=93447) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 24 10:10:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.lockutils [None req-fb6080f8-9032-4d22-b7ec-9a8650cbf53e tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93447) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 24 10:10:31 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fb6080f8-9032-4d22-b7ec-9a8650cbf53e tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 24 10:10:31 devstack sudo[115030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447 Jun 24 10:10:31 devstack sudo[115030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 24 10:10:32 devstack sudo[115030]: pam_unix(sudo:session): session closed for user root Jun 24 10:10:32 devstack cinder-volume[93447]: DEBUG oslo_concurrency.processutils [None req-fb6080f8-9032-4d22-b7ec-9a8650cbf53e tempest-CreateVolumesFromSourceVolumeTest-930811814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f9524adf4a1266b6f3bb00822162b447" returned: 0 in 0.634s {{(pid=93447) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 24 10:10:32 devstack cinder-volume[93447]: DEBUG cinder.manager [None req-fb6080f8-9032-4d22-b7ec-9a8650cbf53e tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Notifying Schedulers of capabilities ... {{(pid=93447) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 24 10:10:32 devstack cinder-volume[93447]: INFO cinder.volume.manager [None req-fb6080f8-9032-4d22-b7ec-9a8650cbf53e tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Deleted volume successfully. Jun 24 10:10:32 devstack cinder-volume[93447]: DEBUG cinder.coordination [None req-fb6080f8-9032-4d22-b7ec-9a8650cbf53e tempest-CreateVolumesFromSourceVolumeTest-930811814 None] Lock "cinder-9278070d-e53d-4aa3-a4a7-a9bc2d47a678-delete_volume" released by "delete_volume" :: held 2.198s {{(pid=93447) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 24 10:10:39 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:DELETE=13,cinder:SELECT=131,cinder:INSERT=50,cinder:UPDATE=197 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 24 10:10:39 devstack cinder-volume[93447]: DEBUG dbcounter [-] [93447] Writing DB stats cinder:DELETE=18,cinder:UPDATE=181,cinder:SELECT=124,cinder:INSERT=51 {{(pid=93447) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}